Jul 12 17:02:31.669092 ip-10-0-133-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 17:02:32.102366 ip-10-0-133-238 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 17:02:32.102366 ip-10-0-133-238 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 17:02:32.102366 ip-10-0-133-238 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 17:02:32.102366 ip-10-0-133-238 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 17:02:32.102366 ip-10-0-133-238 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 17:02:32.105230 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.105141    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 17:02:32.116633 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116595    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.116729 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116714    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.116729 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116720    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.116729 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116724    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.116729 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116728    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.116729 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116731    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116734    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116738    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116741    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116744    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116747    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116750    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116753    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116756    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116768    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116771    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116774    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116777    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116780    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116783    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116786    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116788    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116791    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116794    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116796    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.116883 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116799    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116801    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116804    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116807    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116809    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116812    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116814    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116817    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116820    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116823    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116826    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116829    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116831    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116834    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116837    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116840    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116843    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116845    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116848    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116850    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.117345 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116853    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116856    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116858    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116861    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116865    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116869    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116873    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116876    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116879    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116885    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116888    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116891    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116894    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116898    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116901    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116904    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116907    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116910    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116912    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116915    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.117848 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116918    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116921    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116924    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116926    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116929    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116932    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116935    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116938    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116941    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116943    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116946    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116950    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116956    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116958    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116962    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116964    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116967    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116969    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116973    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.118340 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116976    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116979    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116981    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116984    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116986    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116989    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116991    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116994    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.116996    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117000    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117004    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117007    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117010    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117012    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117015    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117700    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117707    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117710    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117713    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.118805 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117716    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117719    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117722    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117726    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117728    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117731    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117733    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117736    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117739    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117741    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117744    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117747    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117749    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117753    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117755    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117774    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117777    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117781    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117783    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117786    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.119247 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117789    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117791    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117794    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117797    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117799    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117803    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117806    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117808    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117811    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117814    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117817    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117819    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117823    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117825    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117828    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117830    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117833    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117835    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117838    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117841    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.119770 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117843    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117845    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117848    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117850    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117853    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117856    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117859    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117861    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117866    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117870    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117873    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117876    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117879    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117882    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117885    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117887    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117890    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117893    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117896    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.120287 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117899    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117901    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117904    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117906    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117910    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117913    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117916    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117919    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117921    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117924    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117926    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117929    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117931    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117934    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117936    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117939    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117942    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117944    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117947    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117949    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.120735 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117952    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117955    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117959    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117962    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117965    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117968    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117971    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117973    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117976    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117978    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117981    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117984    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117986    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117990    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117994    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.117997    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118410    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118416    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118421    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.121218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118424    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118428    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118431    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118434    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118437    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118440    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118443    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118446    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118449    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118451    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118454    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118457    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118460    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118463    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118466    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118468    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118471    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118473    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118476    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.121673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118478    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118481    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118484    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118486    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118489    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118492    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118495    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118498    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118500    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118503    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118506    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118508    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118510    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118513    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118515    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118517    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118520    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118522    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118525    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118527    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.122157 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118529    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118532    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118534    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118537    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118539    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118542    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118544    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118547    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118549    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118552    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118554    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118557    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118559    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118562    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118564    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118570    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118572    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118575    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118577    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118580    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.122634 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118583    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118585    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118588    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118590    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118593    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118596    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118598    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118601    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118603    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118606    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118608    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118611    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118613    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118616    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118618    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118620    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118623    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118628    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118632    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.123124 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118634    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118639    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118642    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118645    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118648    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118651    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118653    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118657    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118662    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118666    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118668    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118671    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118674    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118677    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118680    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118682    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118685    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.118687    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118754    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118774    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118781    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 17:02:32.123574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118785    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118789    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118792    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118796    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118801    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118804    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118807    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118810    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118814    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118817    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118820    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118823    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118828    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118831    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118834    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118839    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118842    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118845    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118848    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118853    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118856    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118859    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118863    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 17:02:32.124085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118866    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118870    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118873    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118876    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118879    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118881    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118885    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118888    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118891    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118894    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118897    2584 flags.go:64] FLAG: --enable-server="true"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118900    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118905    2584 flags.go:64] FLAG: --event-burst="100"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118908    2584 flags.go:64] FLAG: --event-qps="50"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118910    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118913    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118917    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118925    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118928    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118931    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118934    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118938    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118941    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118945    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118948    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 17:02:32.124630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118951    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118954    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118956    2584 flags.go:64] FLAG: --feature-gates=""
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118961    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118964    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118967    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118970    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118973    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118977    2584 flags.go:64] FLAG: --help="false"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118980    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118982    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118985    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118988    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118992    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118995    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.118998    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119001    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119004    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119007    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119010    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119013    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119015    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119018    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119021    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 17:02:32.125899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119024    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119027    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119030    2584 flags.go:64] FLAG: --lock-file=""
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119033    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119037    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119040    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119045    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119048    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119051    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119054    2584 flags.go:64] FLAG: --logging-format="text"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119057    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119060    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119063    2584 flags.go:64] FLAG: --manifest-url=""
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119066    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119070    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119073    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119077    2584 flags.go:64] FLAG: --max-pods="110"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119080    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119082    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119085    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119089    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119092    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119095    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119098    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119104    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 17:02:32.126567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119107    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119110    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119114    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119117    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119122    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119125    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119128    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119131    2584 flags.go:64] FLAG: --port="10250"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119134    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119136    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-052b447b247ddc18d"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119140    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119143    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119147    2584 flags.go:64] FLAG: --register-node="true"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119150    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119153    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119156    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119159    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119162    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119166    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119169    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119172    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119174    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119177    2584 flags.go:64] FLAG: --runonce="false"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119180    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119183    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 17:02:32.127188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119186    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119189    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119192    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119195    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119198    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119201    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119204    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119206    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119209    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119212    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119215    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119218    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119220    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119226    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119228    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119231    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119235    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119239    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119242    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119246    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119249    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119252    2584 flags.go:64] FLAG: --v="2"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119256    2584 flags.go:64] FLAG: --version="false"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119261    2584 flags.go:64] FLAG: --vmodule=""
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119264    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 17:02:32.127807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.119268    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119382    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119386    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119389    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119394    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119398    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119401    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119405    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119407    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119410    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119413    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119416    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119418    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119421    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119423    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119426    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119428    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119431    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119434    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.128409 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119436    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119438    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119441    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119443    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119446    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119450    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119452    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119456    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119459    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119461    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119465    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119469    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119473    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119476    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119479    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119482    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119485    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119487    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119490    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.128923 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119492    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119495    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119497    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119500    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119502    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119505    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119508    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119510    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119513    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119515    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119518    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119520    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119523    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119525    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119528    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119530    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119533    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119535    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119539    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119541    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.129387 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119545    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119548    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119550    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119553    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119556    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119558    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119561    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119564    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119567    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119569    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119572    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119574    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119577    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119580    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119583    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119586    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119589    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119592    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119595    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119598    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.129916 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119601    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119603    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119606    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119608    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119611    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119613    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119615    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119618    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119620    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119623    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119628    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119631    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119635    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119638    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119641    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119643    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119646    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119648    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119651    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119654    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.130403 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119656    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.119659    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.120586    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.128547    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.128569    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.128595    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.128604    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128685    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128692    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128696    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128701    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128705    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128710    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128713    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.130891 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128717    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128721    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128725    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128731    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128736    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128741    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128745    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128749    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128753    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128771    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128776    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128780    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128784    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128788    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128793    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128798    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128803    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128807    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128812    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128816    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.131238 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128820    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128824    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128830    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128834    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128838    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128842    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128847    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128850    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128856    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128862    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128866    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128870    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128875    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128879    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128883    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128887    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128891    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128895    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128899    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.131719 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128902    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128906    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128910    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128914    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128918    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128921    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128925    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128929    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128933    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128937    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128941    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128945    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128950    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128953    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128958    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128962    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128967    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128971    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128974    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128978    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.132188 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128982    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128986    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128989    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128993    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.128997    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129001    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129004    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129008    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129012    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129016    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129019    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129023    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129027    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129031    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129035    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129038    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129042    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129046    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129049    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129053    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.132657 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129057    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129060    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129064    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129068    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129071    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129075    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129079    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129083    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129087    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129097    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129101    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129104    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129108    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.129115    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129324    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 17:02:32.133137 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129330    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129334    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129339    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129342    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129346    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129351    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129354    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129358    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129362    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129366    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129369    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129373    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129377    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129381    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129385    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129389    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129393    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129396    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129401    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129405    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 17:02:32.133505 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129408    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129412    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129415    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129419    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129424    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129427    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129431    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129443    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129447    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129451    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129455    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129458    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129462    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129466    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129470    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129474    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129478    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129481    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129485    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129489    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 17:02:32.134161 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129493    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129498    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129503    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129506    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129510    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129513    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129517    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129521    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129524    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129528    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129532    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129536    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129539    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129543    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129546    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129550    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129554    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129558    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129562    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 17:02:32.134656 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129565    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129580    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129587    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129591    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129595    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129600    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129604    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129608    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129612    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129616    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129620    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129623    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129627    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129631    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129635    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129639    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129642    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129646    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129650    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 17:02:32.135133 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129654    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129658    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129661    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129665    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129669    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129673    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129677    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129681    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129684    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129688    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129693    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129696    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129700    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129704    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129708    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129719    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129723    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129727    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129730    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 17:02:32.135589 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:32.129734    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 17:02:32.136047 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.129741    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 17:02:32.136047 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.129935    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 17:02:32.229683 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.229645    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 17:02:32.231445 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.231432    2584 server.go:1019] "Starting client certificate rotation"
Jul 12 17:02:32.231580 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.231565    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 17:02:32.231630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.231621    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 17:02:32.234340 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.234321    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 17:02:32.235818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.235790    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 17:02:32.248317 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.248299    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 12 17:02:32.250929 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.250912    2584 log.go:25] "Validated CRI v1 image API"
Jul 12 17:02:32.251903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.251887    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 17:02:32.255429 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.255410    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ab7c2cef-b24a-414e-9cb5-343971011525:/dev/nvme0n1p3 f2b04ed8-1706-4a9a-9ca4-d3fa1dcf7de7:/dev/nvme0n1p4]
Jul 12 17:02:32.255508 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.255429    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 17:02:32.260599 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.260489    2584 manager.go:216] Machine: {Timestamp:2026-07-12 17:02:32.259072523 +0000 UTC m=+0.460905772 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090354 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab257be808868cee2e11d976da8c0 SystemUUID:ec2ab257-be80-8868-cee2-e11d976da8c0 BootID:340e84d6-0e87-4d71-ab82-b7c4cc859232 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:68:48:ac:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:68:48:ac:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:9a:fe:b2:56:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 17:02:32.260599 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.260596    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 17:02:32.260718 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.260706    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 17:02:32.264499 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.264471    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 17:02:32.264638 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.264501    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 17:02:32.265405 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.265390    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 17:02:32.265405 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.265405    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 17:02:32.265517 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.265423    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 17:02:32.265578 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.265562    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 17:02:32.266262 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.266250    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 17:02:32.267635 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.267624    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 17:02:32.272279 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272264    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 17:02:32.272402 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272392    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 17:02:32.272438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272422    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 17:02:32.272438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272432    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 17:02:32.272502 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272447    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 17:02:32.272502 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272456    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 12 17:02:32.272502 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272465    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 17:02:32.272919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272907    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 17:02:32.272975 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.272931    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 17:02:32.275398 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.275379    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 17:02:32.277138 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.277122    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 17:02:32.277226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.277161    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 17:02:32.278007 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.277992    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278012    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278026    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278031    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278039    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278045    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278056    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278064    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278074    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278079    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 17:02:32.278086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278088    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 17:02:32.278347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.278093    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 17:02:32.279752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.279740    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 17:02:32.279752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.279753    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 17:02:32.283121 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.283105    2584 server.go:1268] "Started kubelet"
Jul 12 17:02:32.283252 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.283199    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 17:02:32.283308 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.283278    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 17:02:32.283987 ip-10-0-133-238 systemd[1]: Started Kubernetes Kubelet.
Jul 12 17:02:32.287215 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.287183    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 17:02:32.287215 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.287198    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 17:02:32.287343 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.287239    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 17:02:32.287484 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.287356    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 17:02:32.287542 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.287483    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 17:02:32.290021 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.290005    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 17:02:32.292298 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.292273    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 17:02:32.293597 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.292549    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-238.ec2.internal.18c1998b9a440d0d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-238.ec2.internal,UID:ip-10-0-133-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-238.ec2.internal,},FirstTimestamp:2026-07-12 17:02:32.283081997 +0000 UTC m=+0.484915245,LastTimestamp:2026-07-12 17:02:32.283081997 +0000 UTC m=+0.484915245,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-238.ec2.internal,}"
Jul 12 17:02:32.299188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299167    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 17:02:32.299188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299174    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 17:02:32.299341 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.299321    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.299982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299925    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 17:02:32.299982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299962    2584 factory.go:55] Registering systemd factory
Jul 12 17:02:32.299982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299978    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 12 17:02:32.299982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299978    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 17:02:32.300197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.299995    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 17:02:32.300197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300079    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 17:02:32.300197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300087    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 17:02:32.300197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300181    2584 factory.go:153] Registering CRI-O factory
Jul 12 17:02:32.300197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300193    2584 factory.go:223] Registration of the crio container factory successfully
Jul 12 17:02:32.300440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300261    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 17:02:32.300440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300285    2584 factory.go:103] Registering Raw factory
Jul 12 17:02:32.300440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300301    2584 manager.go:1196] Started watching for new ooms in manager
Jul 12 17:02:32.300723 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.300703    2584 manager.go:349] Starting recovery of all containers
Jul 12 17:02:32.309200 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.309172    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 17:02:32.309353 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.309299    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 17:02:32.310697 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.310681    2584 manager.go:354] Recovery completed
Jul 12 17:02:32.313433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.313414    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rgws8"
Jul 12 17:02:32.314713 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.314701    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.317109 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317095    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.317160 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317124    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.317160 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317134    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.317593 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317580    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 17:02:32.317640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317593    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 17:02:32.317640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317596    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.317640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.317611    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 17:02:32.318475 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.318460    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.318538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.318485    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.318538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.318495    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.319342 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.319273    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-238.ec2.internal.18c1998b9c4b44a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-238.ec2.internal,UID:ip-10-0-133-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-238.ec2.internal,},FirstTimestamp:2026-07-12 17:02:32.317109414 +0000 UTC m=+0.518942662,LastTimestamp:2026-07-12 17:02:32.317109414 +0000 UTC m=+0.518942662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-238.ec2.internal,}"
Jul 12 17:02:32.319878 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.319862    2584 policy_none.go:49] "None policy: Start"
Jul 12 17:02:32.319878 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.319879    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 17:02:32.319975 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.319889    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 17:02:32.320557 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.320545    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rgws8"
Jul 12 17:02:32.321933 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.321921    2584 policy_none.go:47] "Start"
Jul 12 17:02:32.360382 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.360367    2584 manager.go:337] "Starting Device Plugin manager"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.360447    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.360458    2584 server.go:87] "Starting device plugin registration server"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.360839    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.360853    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.360939    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.361022    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.361030    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.361841    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.361894    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.371404    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.372596    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.372631    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.372649    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.372709    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 17:02:32.382669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.374488    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 17:02:32.461459 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.461423    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.463655 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.463637    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.463747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.463677    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.463747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.463693    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.463747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.463726    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.472309 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.472294    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.472401 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.472319    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-238.ec2.internal\": node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.473946 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.473917    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"]
Jul 12 17:02:32.474034 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.473984    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.474824 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.474807    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.474910 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.474835    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.474910 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.474848    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.477183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477169    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.477307 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.477366 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477329    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.477836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477820    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.477836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477835    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.477951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477841    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.477951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477896    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.477951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477854    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.477951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.477930    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.480182 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.480165    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.480240 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.480205    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 17:02:32.480858 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.480844    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 17:02:32.480933 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.480874    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 17:02:32.480933 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.480888    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeHasSufficientPID"
Jul 12 17:02:32.498115 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.498097    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.500290 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.500275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.500346 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.500296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b94e93dfcffd44104222ccfa6f4e9d3f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-238.ec2.internal\" (UID: \"b94e93dfcffd44104222ccfa6f4e9d3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.500346 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.500314    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.508508 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.508487    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-238.ec2.internal\" not found" node="ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.512927 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.512912    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-238.ec2.internal\" not found" node="ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.598780 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.598712    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.601006 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.600986    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.601057 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.601022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.601057 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.601046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b94e93dfcffd44104222ccfa6f4e9d3f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-238.ec2.internal\" (UID: \"b94e93dfcffd44104222ccfa6f4e9d3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.601152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.601095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b94e93dfcffd44104222ccfa6f4e9d3f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-238.ec2.internal\" (UID: \"b94e93dfcffd44104222ccfa6f4e9d3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.601152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.601104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.601232 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.601150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aeff24d1801f6e1684f712ba09ef7e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal\" (UID: \"9aeff24d1801f6e1684f712ba09ef7e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.699198 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.699129    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.800291 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.800244    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:32.812356 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.812336    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.816586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:32.816562    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:32.901572 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:32.901516    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.002319 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.002233    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.109197 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.102884    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.203228 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.203196    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.230672 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.230631    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 17:02:33.230817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.230799    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 17:02:33.264220 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.264149    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 17:02:33.304264 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.304237    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.326521 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.326460    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 16:57:33 +0000 UTC" deadline="2028-02-10 02:46:31.685338961 +0000 UTC"
Jul 12 17:02:33.326521 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.326503    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13857h43m58.358839665s"
Jul 12 17:02:33.404558 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.404391    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.413233 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:33.413203    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aeff24d1801f6e1684f712ba09ef7e4.slice/crio-78e7f4877c01df55b083ae8a6677f1382279ca1f6f80f78de61a443924ad4424 WatchSource:0}: Error finding container 78e7f4877c01df55b083ae8a6677f1382279ca1f6f80f78de61a443924ad4424: Status 404 returned error can't find the container with id 78e7f4877c01df55b083ae8a6677f1382279ca1f6f80f78de61a443924ad4424
Jul 12 17:02:33.418143 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.418124    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 17:02:33.425425 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:33.425400    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94e93dfcffd44104222ccfa6f4e9d3f.slice/crio-e4f1a28acbc979aca9997abe6052427006abbd9e9c82cf4135148e27f84095fa WatchSource:0}: Error finding container e4f1a28acbc979aca9997abe6052427006abbd9e9c82cf4135148e27f84095fa: Status 404 returned error can't find the container with id e4f1a28acbc979aca9997abe6052427006abbd9e9c82cf4135148e27f84095fa
Jul 12 17:02:33.505108 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:33.505074    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-238.ec2.internal\" not found"
Jul 12 17:02:33.533793 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.533712    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 17:02:33.559505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.559482    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 17:02:33.599928 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.599897    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:33.610219 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.610201    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 17:02:33.611426 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.611412    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal"
Jul 12 17:02:33.623422 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:33.623407    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 17:02:34.060837 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.060788    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 17:02:34.273955 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.273923    2584 apiserver.go:52] "Watching apiserver"
Jul 12 17:02:34.286572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.286536    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 17:02:34.286981 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.286953    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46","openshift-cluster-node-tuning-operator/tuned-kctvz","openshift-multus/network-metrics-daemon-9hphh","openshift-network-diagnostics/network-check-target-s75vp","openshift-ovn-kubernetes/ovnkube-node-pqb9n","kube-system/global-pull-secret-syncer-x462c","kube-system/konnectivity-agent-5422l","openshift-dns/node-resolver-hsdxt","openshift-image-registry/node-ca-cgc76","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal","openshift-multus/multus-additional-cni-plugins-ljxvg","openshift-multus/multus-z82br","openshift-network-operator/iptables-alerter-rzsfc"]
Jul 12 17:02:34.289761 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.289735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.289897 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.289859    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:34.292160 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.292126    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.294611 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.294586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.295947 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.295920    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.296159 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.296141    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 17:02:34.296404 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.296384    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 17:02:34.296473 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.296449    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.296929 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.296899    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5f75z\""
Jul 12 17:02:34.297021 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.296957    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.297204 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.297187    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.297280 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.297253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:34.297280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.297269    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-shwc4\""
Jul 12 17:02:34.297536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.297518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.299428 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.299411    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:34.299523 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.299483    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:34.300569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.300533    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 17:02:34.302025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.301791    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.304247 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.304225    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.304806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.304785    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 17:02:34.305936 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.305918    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 17:02:34.306074 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306051    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 17:02:34.306188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306072    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.306188 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306172    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.306301 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306252    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 17:02:34.306301 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cxbn5\""
Jul 12 17:02:34.306469 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306447    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.306702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306660    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.306929 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.306912    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ts6sj\""
Jul 12 17:02:34.307985 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.307955    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.309315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309288    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-conf\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.309414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309329    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-run\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.309414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309355    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.309414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309380    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-netd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.309414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-socket-dir-parent\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-k8s-cni-cncf-io\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-kubelet\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309482    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5sq\" (UniqueName: \"kubernetes.io/projected/6284bb2f-3b84-4586-92d0-ce568d42cb91-kube-api-access-nq5sq\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-var-lib-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309532    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-kubernetes\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-sys\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309602    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-config\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.309625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309625    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-kubelet\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6fng\" (UniqueName: \"kubernetes.io/projected/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-kube-api-access-s6fng\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309735    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cs58\" (UniqueName: \"kubernetes.io/projected/98c1cfc8-e092-430a-a10b-e494ded47663-kube-api-access-8cs58\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-var-lib-kubelet\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-log-socket\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.309857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-multus\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-modprobe-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.310321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310177    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-script-lib\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-netns\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-multus-certs\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-systemd-units\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-dbus\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-hostroot\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-bin\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-cnibin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-multus-daemon-config\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-node-log\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.310570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-cni-binary-copy\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-lib-modules\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-tmp\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-etc-tuned\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-ovn\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-system-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-os-release\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysconfig\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-etc-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-systemd\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-host\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310897    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrh2s\" (UniqueName: \"kubernetes.io/projected/2a149407-d693-481f-92ed-365365b9590f-kube-api-access-mrh2s\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-kubelet-config\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.310999    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-bin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-conf-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-netns\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-systemd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311136    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-slash\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311184    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-env-overrides\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovn-node-metrics-cert\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.311536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-etc-kubernetes\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.311950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311538    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qlwk5\""
Jul 12 17:02:34.311950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311545    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.311950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.311950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.311737    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 17:02:34.313710 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.313689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.314387 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.314368    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 17:02:34.314538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.314522    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.314733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.314718    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.314922 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.314897    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ssf9h\""
Jul 12 17:02:34.315763 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.315739    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 17:02:34.317969 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.316388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.318240 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.316740    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 17:02:34.318445 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.316729    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 17:02:34.318445 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.317158    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 17:02:34.318445 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.317211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6bhd6\""
Jul 12 17:02:34.320046 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.320023    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.321498 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.321464    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 17:02:34.321882 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.321862    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjnhd\""
Jul 12 17:02:34.322227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.322212    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 17:02:34.323799 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.323781    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nxh5n\""
Jul 12 17:02:34.324089 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.324063    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 17:02:34.324180 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.324064    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 17:02:34.337102 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.337079    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdksz"
Jul 12 17:02:34.348751 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.348361    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdksz"
Jul 12 17:02:34.378744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.378690    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal" event={"ID":"b94e93dfcffd44104222ccfa6f4e9d3f","Type":"ContainerStarted","Data":"e4f1a28acbc979aca9997abe6052427006abbd9e9c82cf4135148e27f84095fa"}
Jul 12 17:02:34.380423 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.380395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal" event={"ID":"9aeff24d1801f6e1684f712ba09ef7e4","Type":"ContainerStarted","Data":"78e7f4877c01df55b083ae8a6677f1382279ca1f6f80f78de61a443924ad4424"}
Jul 12 17:02:34.401300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.401276    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 17:02:34.412067 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-netd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412101    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-socket-dir-parent\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-socket-dir-parent\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-netd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-k8s-cni-cncf-io\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-kubelet\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5sq\" (UniqueName: \"kubernetes.io/projected/6284bb2f-3b84-4586-92d0-ce568d42cb91-kube-api-access-nq5sq\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-var-lib-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-registration-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412373    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-kubelet\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxfq\" (UniqueName: \"kubernetes.io/projected/cf591d7f-cfeb-4150-974e-65132a67e791-kube-api-access-rtxfq\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-k8s-cni-cncf-io\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trr9\" (UniqueName: \"kubernetes.io/projected/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-kube-api-access-2trr9\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-var-lib-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412452    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-kubernetes\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-sys\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-config\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-kubernetes\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-agent-certs\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.412733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-binary-copy\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412715    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-sys\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-kubelet\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6fng\" (UniqueName: \"kubernetes.io/projected/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-kube-api-access-s6fng\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cs58\" (UniqueName: \"kubernetes.io/projected/98c1cfc8-e092-430a-a10b-e494ded47663-kube-api-access-8cs58\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412964    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2bf471-5e6a-4800-add6-0cd85482041f-tmp-dir\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.412992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-var-lib-kubelet\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-log-socket\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-var-lib-kubelet\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413155    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-multus\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9551f7b-f6c7-4546-a828-175e0d309018-iptables-alerter-script\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.413807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-kubelet\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413223    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-cnibin\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413241    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-log-socket\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413346    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-multus\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-modprobe-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-script-lib\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-netns\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413499    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-netns\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413560    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-modprobe-d\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-multus-certs\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-systemd-units\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-dbus\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-hostroot\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-bin\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-cnibin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413862    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-multus-daemon-config\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413928    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-konnectivity-ca\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.415025 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-node-log\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.413982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-cni-binary-copy\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-lib-modules\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-tmp\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-config\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovnkube-script-lib\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414175    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9551f7b-f6c7-4546-a828-175e0d309018-host-slash\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-etc-tuned\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-ovn\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-cni-bin\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-system-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-cnibin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-os-release\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414385    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2bf471-5e6a-4800-add6-0cd85482041f-hosts-file\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-socket-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-run-multus-certs\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.415951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-systemd-units\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysconfig\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-etc-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414587    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-host\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ct5q\" (UniqueName: \"kubernetes.io/projected/4824959f-2ceb-4881-a948-d97585094606-kube-api-access-2ct5q\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-systemd\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-cni-binary-copy\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414670    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-host\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrh2s\" (UniqueName: \"kubernetes.io/projected/2a149407-d693-481f-92ed-365365b9590f-kube-api-access-mrh2s\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414733    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-os-release\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414742    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-kubelet-config\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-bin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.414823    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-conf-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.416771 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.414976    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:34.914953526 +0000 UTC m=+3.116786778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.414972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-dbus\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415097    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-etc-openvswitch\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415139    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-node-log\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysconfig\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-host-var-lib-cni-bin\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.415273    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-lib-modules\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.415365    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:34.915347415 +0000 UTC m=+3.117180653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415397    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f022beb1-077c-4449-b0d8-ef5d9897c525-kubelet-config\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-hostroot\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415434    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98c1cfc8-e092-430a-a10b-e494ded47663-multus-daemon-config\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-netns\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-systemd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415483    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-system-cni-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415503    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjrj\" (UniqueName: \"kubernetes.io/projected/6a2bf471-5e6a-4800-add6-0cd85482041f-kube-api-access-nnjrj\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415519    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-ovn\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.418071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415443    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-host\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjh5b\" (UniqueName: \"kubernetes.io/projected/a9551f7b-f6c7-4546-a828-175e0d309018-kube-api-access-sjh5b\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-run-systemd\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-sys-fs\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-systemd\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-serviceca\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415662    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-run-netns\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-slash\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-multus-conf-dir\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-slash\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-env-overrides\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovn-node-metrics-cert\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-etc-kubernetes\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.415972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-device-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.419644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c1cfc8-e092-430a-a10b-e494ded47663-etc-kubernetes\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416107    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-system-cni-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416142    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-os-release\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-conf\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-run\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-env-overrides\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416322    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-run\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.416438    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a149407-d693-481f-92ed-365365b9590f-etc-sysctl-conf\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.419253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-etc-tuned\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.419356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-ovn-node-metrics-cert\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.419451    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.419474    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.419514    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.419576    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:34.919560323 +0000 UTC m=+3.121393577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:34.420572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.419915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a149407-d693-481f-92ed-365365b9590f-tmp\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.423834 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.423795    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5sq\" (UniqueName: \"kubernetes.io/projected/6284bb2f-3b84-4586-92d0-ce568d42cb91-kube-api-access-nq5sq\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.426691 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.426658    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cs58\" (UniqueName: \"kubernetes.io/projected/98c1cfc8-e092-430a-a10b-e494ded47663-kube-api-access-8cs58\") pod \"multus-z82br\" (UID: \"98c1cfc8-e092-430a-a10b-e494ded47663\") " pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.426691 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.426672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6fng\" (UniqueName: \"kubernetes.io/projected/b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff-kube-api-access-s6fng\") pod \"ovnkube-node-pqb9n\" (UID: \"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.428877 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.428855    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrh2s\" (UniqueName: \"kubernetes.io/projected/2a149407-d693-481f-92ed-365365b9590f-kube-api-access-mrh2s\") pod \"tuned-kctvz\" (UID: \"2a149407-d693-481f-92ed-365365b9590f\") " pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.516771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516716    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.516771 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9551f7b-f6c7-4546-a828-175e0d309018-host-slash\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2bf471-5e6a-4800-add6-0cd85482041f-hosts-file\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-socket-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-host\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ct5q\" (UniqueName: \"kubernetes.io/projected/4824959f-2ceb-4881-a948-d97585094606-kube-api-access-2ct5q\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjrj\" (UniqueName: \"kubernetes.io/projected/6a2bf471-5e6a-4800-add6-0cd85482041f-kube-api-access-nnjrj\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjh5b\" (UniqueName: \"kubernetes.io/projected/a9551f7b-f6c7-4546-a828-175e0d309018-kube-api-access-sjh5b\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.516976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2bf471-5e6a-4800-add6-0cd85482041f-hosts-file\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-sys-fs\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-socket-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-serviceca\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517069    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-device-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-system-cni-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9551f7b-f6c7-4546-a828-175e0d309018-host-slash\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-os-release\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-registration-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-system-cni-dir\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxfq\" (UniqueName: \"kubernetes.io/projected/cf591d7f-cfeb-4150-974e-65132a67e791-kube-api-access-rtxfq\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-device-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trr9\" (UniqueName: \"kubernetes.io/projected/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-kube-api-access-2trr9\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-host\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-agent-certs\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.517584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-binary-copy\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517348    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517111    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-sys-fs\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2bf471-5e6a-4800-add6-0cd85482041f-tmp-dir\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9551f7b-f6c7-4546-a828-175e0d309018-iptables-alerter-script\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-cnibin\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517479    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-os-release\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-serviceca\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-konnectivity-ca\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf591d7f-cfeb-4150-974e-65132a67e791-registration-dir\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4824959f-2ceb-4881-a948-d97585094606-cnibin\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2bf471-5e6a-4800-add6-0cd85482041f-tmp-dir\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.517997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.518179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-konnectivity-ca\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.518439 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.518224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9551f7b-f6c7-4546-a828-175e0d309018-iptables-alerter-script\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.519018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.518520    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.519018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.518523    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4824959f-2ceb-4881-a948-d97585094606-cni-binary-copy\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.520155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.520132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83a5cc91-30e8-40f9-8931-d2d9ac327c1c-agent-certs\") pod \"konnectivity-agent-5422l\" (UID: \"83a5cc91-30e8-40f9-8931-d2d9ac327c1c\") " pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.527634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.527579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ct5q\" (UniqueName: \"kubernetes.io/projected/4824959f-2ceb-4881-a948-d97585094606-kube-api-access-2ct5q\") pod \"multus-additional-cni-plugins-ljxvg\" (UID: \"4824959f-2ceb-4881-a948-d97585094606\") " pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.528510 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.528488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trr9\" (UniqueName: \"kubernetes.io/projected/d61dc20c-65cc-4d35-a1f8-614b6c2c8abb-kube-api-access-2trr9\") pod \"node-ca-cgc76\" (UID: \"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb\") " pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.529201 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.529178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjrj\" (UniqueName: \"kubernetes.io/projected/6a2bf471-5e6a-4800-add6-0cd85482041f-kube-api-access-nnjrj\") pod \"node-resolver-hsdxt\" (UID: \"6a2bf471-5e6a-4800-add6-0cd85482041f\") " pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.529888 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.529863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjh5b\" (UniqueName: \"kubernetes.io/projected/a9551f7b-f6c7-4546-a828-175e0d309018-kube-api-access-sjh5b\") pod \"iptables-alerter-rzsfc\" (UID: \"a9551f7b-f6c7-4546-a828-175e0d309018\") " pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.529976 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.529869    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxfq\" (UniqueName: \"kubernetes.io/projected/cf591d7f-cfeb-4150-974e-65132a67e791-kube-api-access-rtxfq\") pod \"aws-ebs-csi-driver-node-q6k46\" (UID: \"cf591d7f-cfeb-4150-974e-65132a67e791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.608625 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.608535    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z82br"
Jul 12 17:02:34.627277 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.627252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kctvz"
Jul 12 17:02:34.639312 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.639285    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:02:34.644189 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.644170    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsdxt"
Jul 12 17:02:34.652877 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.652852    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzsfc"
Jul 12 17:02:34.660784 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.660752    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46"
Jul 12 17:02:34.669664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.669645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgc76"
Jul 12 17:02:34.678720 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.678686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:34.685628 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.685609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ljxvg"
Jul 12 17:02:34.920415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.920323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:34.920415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.920376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:34.920646 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920507    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:34.920646 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:34.920553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:34.920646 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920574    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:35.920552751 +0000 UTC m=+4.122385989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:34.920646 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920509    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:34.920883 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920674    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:34.920883 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920694    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:34.920883 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920709    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:34.920883 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920676    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:35.920656397 +0000 UTC m=+4.122489652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:34.920883 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:34.920772    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:35.920753799 +0000 UTC m=+4.122587044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:35.351924 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.351823    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:57:35 +0000 UTC" deadline="2028-03-31 21:29:53.99484148 +0000 UTC"
Jul 12 17:02:35.351924 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.351865    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15076h27m18.642980513s"
Jul 12 17:02:35.373360 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.373321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:35.373554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.373321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:35.373554 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.373476    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:35.373554 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.373536    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:35.582922 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.582879    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9551f7b_f6c7_4546_a828_175e0d309018.slice/crio-5f046d17a58c20fe1e9e35305b1c082b77f8041b110dc78d83196c7ddf377794 WatchSource:0}: Error finding container 5f046d17a58c20fe1e9e35305b1c082b77f8041b110dc78d83196c7ddf377794: Status 404 returned error can't find the container with id 5f046d17a58c20fe1e9e35305b1c082b77f8041b110dc78d83196c7ddf377794
Jul 12 17:02:35.589016 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.588979    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e1d7e4_4d5e_4599_bc08_cf8561ea33ff.slice/crio-ac166ec56e5a6ceb56f92a99b087a04a496585c3f2186427a84754edd5864d76 WatchSource:0}: Error finding container ac166ec56e5a6ceb56f92a99b087a04a496585c3f2186427a84754edd5864d76: Status 404 returned error can't find the container with id ac166ec56e5a6ceb56f92a99b087a04a496585c3f2186427a84754edd5864d76
Jul 12 17:02:35.591989 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.591945    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a5cc91_30e8_40f9_8931_d2d9ac327c1c.slice/crio-5976b6841eebe9196b147c0423c683e126a63f06a2d4e06b15c42b287f44a745 WatchSource:0}: Error finding container 5976b6841eebe9196b147c0423c683e126a63f06a2d4e06b15c42b287f44a745: Status 404 returned error can't find the container with id 5976b6841eebe9196b147c0423c683e126a63f06a2d4e06b15c42b287f44a745
Jul 12 17:02:35.593016 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.592985    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a149407_d693_481f_92ed_365365b9590f.slice/crio-da5489509c350155f4c1d2c983cdafbede3d5680e1b245f5e6197b49c71236dc WatchSource:0}: Error finding container da5489509c350155f4c1d2c983cdafbede3d5680e1b245f5e6197b49c71236dc: Status 404 returned error can't find the container with id da5489509c350155f4c1d2c983cdafbede3d5680e1b245f5e6197b49c71236dc
Jul 12 17:02:35.594790 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.594764    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c1cfc8_e092_430a_a10b_e494ded47663.slice/crio-ce7cb73c26720538a1e53a99786a613c373d3f033dc2dbddf193a42832ea6354 WatchSource:0}: Error finding container ce7cb73c26720538a1e53a99786a613c373d3f033dc2dbddf193a42832ea6354: Status 404 returned error can't find the container with id ce7cb73c26720538a1e53a99786a613c373d3f033dc2dbddf193a42832ea6354
Jul 12 17:02:35.616744 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.616716    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61dc20c_65cc_4d35_a1f8_614b6c2c8abb.slice/crio-45ce35d51c86d48620f7c3a5797eb766f66de7bd03acfa9cec5fa873365a5115 WatchSource:0}: Error finding container 45ce35d51c86d48620f7c3a5797eb766f66de7bd03acfa9cec5fa873365a5115: Status 404 returned error can't find the container with id 45ce35d51c86d48620f7c3a5797eb766f66de7bd03acfa9cec5fa873365a5115
Jul 12 17:02:35.618394 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.618366    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2bf471_5e6a_4800_add6_0cd85482041f.slice/crio-e4d1003c5c6e7f331e6d7b6efc3eb9d0e2a6b57754b4f7196d06d31ae252be09 WatchSource:0}: Error finding container e4d1003c5c6e7f331e6d7b6efc3eb9d0e2a6b57754b4f7196d06d31ae252be09: Status 404 returned error can't find the container with id e4d1003c5c6e7f331e6d7b6efc3eb9d0e2a6b57754b4f7196d06d31ae252be09
Jul 12 17:02:35.618993 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.618965    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4824959f_2ceb_4881_a948_d97585094606.slice/crio-9a926e38cd08f9819b3e199f15d8eb5959baea8b8523be66ddc6a4f1df551e1d WatchSource:0}: Error finding container 9a926e38cd08f9819b3e199f15d8eb5959baea8b8523be66ddc6a4f1df551e1d: Status 404 returned error can't find the container with id 9a926e38cd08f9819b3e199f15d8eb5959baea8b8523be66ddc6a4f1df551e1d
Jul 12 17:02:35.619905 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:02:35.619881    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf591d7f_cfeb_4150_974e_65132a67e791.slice/crio-d227eb42607c89dc9a08b1cb41f6ecf3f931824fcc61b03c8dd923b245aa0bb0 WatchSource:0}: Error finding container d227eb42607c89dc9a08b1cb41f6ecf3f931824fcc61b03c8dd923b245aa0bb0: Status 404 returned error can't find the container with id d227eb42607c89dc9a08b1cb41f6ecf3f931824fcc61b03c8dd923b245aa0bb0
Jul 12 17:02:35.927478 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.927441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:35.927634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.927503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:35.927634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:35.927539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:35.927634 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927624    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:35.927782 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927649    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:35.927782 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927654    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:35.927782 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927726    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:37.927710047 +0000 UTC m=+6.129543283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:35.927782 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927656    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:35.927943 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927804    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:37.927791069 +0000 UTC m=+6.129624317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:35.927943 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927659    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:35.927943 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:35.927844    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:37.92783665 +0000 UTC m=+6.129669887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:36.352651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.352538    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:57:35 +0000 UTC" deadline="2028-02-26 21:12:09.247976181 +0000 UTC"
Jul 12 17:02:36.352651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.352601    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14260h9m32.895379115s"
Jul 12 17:02:36.376043 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.376007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:36.376203 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:36.376151    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:36.395781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.395712    2584 generic.go:356] "Generic (PLEG): container finished" podID="9aeff24d1801f6e1684f712ba09ef7e4" containerID="528455833d8177ab8fd5fb3576305d6da68c5337336f16cd3668b6e7dfbc98a7" exitCode=0
Jul 12 17:02:36.396130 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.396089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal" event={"ID":"9aeff24d1801f6e1684f712ba09ef7e4","Type":"ContainerDied","Data":"528455833d8177ab8fd5fb3576305d6da68c5337336f16cd3668b6e7dfbc98a7"}
Jul 12 17:02:36.403868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.403841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsdxt" event={"ID":"6a2bf471-5e6a-4800-add6-0cd85482041f","Type":"ContainerStarted","Data":"e4d1003c5c6e7f331e6d7b6efc3eb9d0e2a6b57754b4f7196d06d31ae252be09"}
Jul 12 17:02:36.416464 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.416427    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgc76" event={"ID":"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb","Type":"ContainerStarted","Data":"45ce35d51c86d48620f7c3a5797eb766f66de7bd03acfa9cec5fa873365a5115"}
Jul 12 17:02:36.440891 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.440748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"ac166ec56e5a6ceb56f92a99b087a04a496585c3f2186427a84754edd5864d76"}
Jul 12 17:02:36.447990 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.447879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46" event={"ID":"cf591d7f-cfeb-4150-974e-65132a67e791","Type":"ContainerStarted","Data":"d227eb42607c89dc9a08b1cb41f6ecf3f931824fcc61b03c8dd923b245aa0bb0"}
Jul 12 17:02:36.451353 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.451270    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerStarted","Data":"9a926e38cd08f9819b3e199f15d8eb5959baea8b8523be66ddc6a4f1df551e1d"}
Jul 12 17:02:36.457352 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.457324    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z82br" event={"ID":"98c1cfc8-e092-430a-a10b-e494ded47663","Type":"ContainerStarted","Data":"ce7cb73c26720538a1e53a99786a613c373d3f033dc2dbddf193a42832ea6354"}
Jul 12 17:02:36.462233 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.462205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kctvz" event={"ID":"2a149407-d693-481f-92ed-365365b9590f","Type":"ContainerStarted","Data":"da5489509c350155f4c1d2c983cdafbede3d5680e1b245f5e6197b49c71236dc"}
Jul 12 17:02:36.467261 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.467231    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5422l" event={"ID":"83a5cc91-30e8-40f9-8931-d2d9ac327c1c","Type":"ContainerStarted","Data":"5976b6841eebe9196b147c0423c683e126a63f06a2d4e06b15c42b287f44a745"}
Jul 12 17:02:36.477807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.477775    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzsfc" event={"ID":"a9551f7b-f6c7-4546-a828-175e0d309018","Type":"ContainerStarted","Data":"5f046d17a58c20fe1e9e35305b1c082b77f8041b110dc78d83196c7ddf377794"}
Jul 12 17:02:36.486496 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:36.486466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal" event={"ID":"b94e93dfcffd44104222ccfa6f4e9d3f","Type":"ContainerStarted","Data":"b6de9033d9a6c71b49c82c9255508cdbe6fab84e17be4f88b9941585ef76fe59"}
Jul 12 17:02:37.373997 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.373671    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:37.374476 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.374063    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:37.374540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.374509    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:37.374677 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.374620    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:37.513003 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.512917    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal" event={"ID":"9aeff24d1801f6e1684f712ba09ef7e4","Type":"ContainerStarted","Data":"0a1c76146053b0174afc6d83e06947c8693cde4e4f90b4e145c4d1c688732fcd"}
Jul 12 17:02:37.531498 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.530180    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-238.ec2.internal" podStartSLOduration=3.530156179 podStartE2EDuration="3.530156179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:36.502753328 +0000 UTC m=+4.704586590" watchObservedRunningTime="2026-07-12 17:02:37.530156179 +0000 UTC m=+5.731989441"
Jul 12 17:02:37.949222 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.949179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:37.949420 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.949275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:37.949420 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:37.949318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:37.949551 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.949467    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:37.949614 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.949592    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:41.949571638 +0000 UTC m=+10.151404899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:37.950153 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950121    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:37.950278 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950165    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:37.950278 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950181    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:37.950278 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950264    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:41.950248007 +0000 UTC m=+10.152081247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:37.950452 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950331    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:37.950452 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:37.950380    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:41.950358945 +0000 UTC m=+10.152192184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:38.376116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:38.376083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:38.376594 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:38.376241    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:39.373652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:39.373606    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:39.373902 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:39.373621    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:39.373902 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:39.373765    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:39.374044 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:39.373947    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:40.373575 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:40.373536    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:40.374101 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:40.373688    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:41.373335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:41.373303    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:41.373505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:41.373389    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:41.373505 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.373435    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:41.373505 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.373488    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:41.986639 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:41.986605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:41.986652    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:41.986691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986804    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986830    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986878    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:49.986856008 +0000 UTC m=+18.188689244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986833    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986900    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:49.986889235 +0000 UTC m=+18.188722474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986909    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986925    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:41.987165 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:41.986972    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:02:49.986956083 +0000 UTC m=+18.188789325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:42.373921 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:42.373869    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:42.374159 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:42.373993    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:43.373961 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:43.373918    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:43.374461 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:43.374044    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:43.374461 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:43.374055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:43.374461 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:43.374153    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:44.373698 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:44.373647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:44.373881 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:44.373806    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:45.373113 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:45.373074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:45.373554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:45.373127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:45.373554 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:45.373186    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:45.373554 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:45.373241    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:46.373744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:46.373715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:46.374126 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:46.373830    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:47.373568 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:47.373513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:47.373756 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:47.373513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:47.373756 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:47.373740    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:47.374288 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:47.373856    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:48.373669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:48.373620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:48.373848 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:48.373777    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:49.373835 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:49.373799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:49.374317 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:49.373845    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:49.374317 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:49.373924    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:49.374317 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:49.374059    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:50.051259 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:50.051209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:50.051446 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:50.051269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:50.051446 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:50.051322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:50.051446 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051368    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:50.051446 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051368    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:50.051446 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051442    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:06.051420892 +0000 UTC m=+34.253254150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:02:50.051716 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051457    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:02:50.051716 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051473    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:02:50.051716 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051485    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:50.051716 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051494    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:06.051473532 +0000 UTC m=+34.253306779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:02:50.051716 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.051528    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:06.051514127 +0000 UTC m=+34.253347379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:02:50.373078 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:50.373048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:50.373251 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:50.373171    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:51.373639 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:51.373586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:51.374116 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:51.373713    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:51.374116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:51.373783    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:51.374116 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:51.373901    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:52.376856 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:52.375679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:52.377314 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:52.376828    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:53.372838 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:53.372804    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:53.373012 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:53.372806    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:53.373012 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:53.372922    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:53.373120 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:53.373015    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:54.373381 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:54.373346    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:54.373958 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:54.373499    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:55.373844 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.373620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:55.374507 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.373637    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:55.374507 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:55.373927    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:55.374507 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:55.374018    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:55.556277 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.556188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsdxt" event={"ID":"6a2bf471-5e6a-4800-add6-0cd85482041f","Type":"ContainerStarted","Data":"b9a514e131a231d822d8257529f83d914ab76a22219ef80f998611c6f60fabf9"}
Jul 12 17:02:55.557824 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.557797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgc76" event={"ID":"d61dc20c-65cc-4d35-a1f8-614b6c2c8abb","Type":"ContainerStarted","Data":"8052ec7f84545cbabcf06aaf5268b72389494b249cc43efbf54b18f922ba313b"}
Jul 12 17:02:55.561018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.560988    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"0f9dc3082b849a09c68b20496392c016482d8d36d4626c689e213cd94be6562c"}
Jul 12 17:02:55.561114 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.561062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"d0fbc42180fb3bed04181321f938110293409356794e51c382c5fc4ae862f9ad"}
Jul 12 17:02:55.561178 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.561131    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"b55a3c15c4ea1d79cf222e98a9e9751b0fd7b4d1c898259b19d82d1c793c8360"}
Jul 12 17:02:55.561226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.561183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"e60e2ce055a3152c9ba6270fcdc7dab03c76727a03bd90042e02f4b44f33e409"}
Jul 12 17:02:55.561271 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.561234    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"3085d55a0b9b48f3663950f3b38ca393a036b436854eb4434cfff683e5a0df30"}
Jul 12 17:02:55.561319 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.561282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"39ff65f3fc8482200d4744fff91b638c5c3502e6b6a5e2d57f360bd6010657ac"}
Jul 12 17:02:55.562562 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.562535    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46" event={"ID":"cf591d7f-cfeb-4150-974e-65132a67e791","Type":"ContainerStarted","Data":"07ca92e8da30c0417b19145bf76f2233c9ef2ddb35feef73144ec7122d06020a"}
Jul 12 17:02:55.564211 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.564187    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="bffe6e71edc9e9027dc546282cd54b2d0fcf1da23597bb9584a7ea8fd29acfdd" exitCode=0
Jul 12 17:02:55.564327 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.564272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"bffe6e71edc9e9027dc546282cd54b2d0fcf1da23597bb9584a7ea8fd29acfdd"}
Jul 12 17:02:55.565988 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.565963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z82br" event={"ID":"98c1cfc8-e092-430a-a10b-e494ded47663","Type":"ContainerStarted","Data":"8e67d8838f28fcd4c74ac7e827128f68a9f4110d2dd28e34f36e8d04bd2ef6be"}
Jul 12 17:02:55.569051 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.568335    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kctvz" event={"ID":"2a149407-d693-481f-92ed-365365b9590f","Type":"ContainerStarted","Data":"48a81cfa766630f7a2a4c66138b42d85ab6527db7558875b8addd64aa8fe08b4"}
Jul 12 17:02:55.570565 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.570522    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hsdxt" podStartSLOduration=3.601207317 podStartE2EDuration="22.570509605s" totalImagesPullingTime="18.969302288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:55.569956754 +0000 UTC m=+23.771790012" watchObservedRunningTime="2026-07-12 17:02:55.570509605 +0000 UTC m=+23.772342862"
Jul 12 17:02:55.570687 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.570656    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-238.ec2.internal" podStartSLOduration=21.570647932 podStartE2EDuration="21.570647932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:37.531454651 +0000 UTC m=+5.733287912" watchObservedRunningTime="2026-07-12 17:02:55.570647932 +0000 UTC m=+23.772481188"
Jul 12 17:02:55.570881 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.570859    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5422l" event={"ID":"83a5cc91-30e8-40f9-8931-d2d9ac327c1c","Type":"ContainerStarted","Data":"3bc581b2742931915b5e116b5b76aa1b19cfd21f60146a1b41faef77670f0156"}
Jul 12 17:02:55.606139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.606083    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z82br" podStartSLOduration=3.569215297 podStartE2EDuration="22.606068105s" totalImagesPullingTime="19.036852808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:55.605634436 +0000 UTC m=+23.807467694" watchObservedRunningTime="2026-07-12 17:02:55.606068105 +0000 UTC m=+23.807901361"
Jul 12 17:02:55.622055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.622015    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kctvz" podStartSLOduration=3.6402348140000003 podStartE2EDuration="22.622002187s" totalImagesPullingTime="18.981767373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:55.621666727 +0000 UTC m=+23.823499984" watchObservedRunningTime="2026-07-12 17:02:55.622002187 +0000 UTC m=+23.823835445"
Jul 12 17:02:55.637260 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:55.637218    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cgc76" podStartSLOduration=3.659780639 podStartE2EDuration="22.637198599s" totalImagesPullingTime="18.97741796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:55.637093194 +0000 UTC m=+23.838926450" watchObservedRunningTime="2026-07-12 17:02:55.637198599 +0000 UTC m=+23.839031856"
Jul 12 17:02:56.200634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.200611    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 17:02:56.373300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.373263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:56.373492 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:56.373391    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:56.375676 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.375583    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T17:02:56.200629626Z","UUID":"680919e6-0037-47d3-8232-4551d9046e29","Handler":null,"Name":"","Endpoint":""}
Jul 12 17:02:56.377149 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.377130    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 17:02:56.377255 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.377171    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 17:02:56.576171 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.576132    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46" event={"ID":"cf591d7f-cfeb-4150-974e-65132a67e791","Type":"ContainerStarted","Data":"80720ff362f6d406fd417029c39adaa9ddd372f8a16e4972e0a16fdd396e6a22"}
Jul 12 17:02:56.579180 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.579149    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzsfc" event={"ID":"a9551f7b-f6c7-4546-a828-175e0d309018","Type":"ContainerStarted","Data":"e53d6bc186ac80549e76cc3df03203b46bebb601deafea9b0a72a6db5ddc91ef"}
Jul 12 17:02:56.593736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.593672    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rzsfc" podStartSLOduration=4.587090564 podStartE2EDuration="23.593653767s" totalImagesPullingTime="19.006563203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:56.593477749 +0000 UTC m=+24.795311007" watchObservedRunningTime="2026-07-12 17:02:56.593653767 +0000 UTC m=+24.795487026"
Jul 12 17:02:56.594233 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:56.594205    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5422l" podStartSLOduration=8.933006317 podStartE2EDuration="23.594195542s" totalImagesPullingTime="14.661189225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:55.659560698 +0000 UTC m=+23.861393956" watchObservedRunningTime="2026-07-12 17:02:56.594195542 +0000 UTC m=+24.796028800"
Jul 12 17:02:57.373109 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:57.373074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:57.373296 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:57.373199    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:57.373296 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:57.373255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:57.373450 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:57.373385    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:58.373161 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:58.373122    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:02:58.374015 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:58.373241    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:02:58.586527 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:58.586407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46" event={"ID":"cf591d7f-cfeb-4150-974e-65132a67e791","Type":"ContainerStarted","Data":"f7676d4418658f8d8f372a3152f2ae3090bb42024e730f234b13528d09820c34"}
Jul 12 17:02:58.592413 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:58.592385    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"527e592aea2ff2af2e053eebd27b6e51ec9e00471d66284bd5ad3d77255330af"}
Jul 12 17:02:59.009653 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.009615    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:59.010322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.010303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:59.024990 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.024943    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6k46" podStartSLOduration=4.436215185 podStartE2EDuration="26.024926792s" totalImagesPullingTime="21.588711607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:02:58.604142239 +0000 UTC m=+26.805975497" watchObservedRunningTime="2026-07-12 17:02:59.024926792 +0000 UTC m=+27.226760048"
Jul 12 17:02:59.373248 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.373219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:02:59.373828 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.373219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:02:59.373828 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:59.373329    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:02:59.373828 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:02:59.373439    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:02:59.594803 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.594751    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:02:59.595459 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:02:59.595435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5422l"
Jul 12 17:03:00.373781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:00.373730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:00.374242 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:00.373879    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:01.374003 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.373817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:01.374415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.373817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:01.374415 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:01.374118    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:03:01.374415 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:01.374140    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:03:01.602664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.602614    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" event={"ID":"b5e1d7e4-4d5e-4599-bc08-cf8561ea33ff","Type":"ContainerStarted","Data":"d656ad2d48239f559cb3d1730c4cd6fa817fb789d8ee7eda27d824883949840e"}
Jul 12 17:03:01.603060 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.602914    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:01.603060 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.602989    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:01.603060 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.603020    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:01.605120 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.605094    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="d228e2591b5cc876b1db53a7df6621264ca12a953956762693600f93d1bf72ea" exitCode=0
Jul 12 17:03:01.605241 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.605125    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"d228e2591b5cc876b1db53a7df6621264ca12a953956762693600f93d1bf72ea"}
Jul 12 17:03:01.619404 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.619378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:01.619532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.619486    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:01.654109 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:01.654000    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n" podStartSLOduration=9.579764538 podStartE2EDuration="28.653982853s" totalImagesPullingTime="19.074218315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:01.653964402 +0000 UTC m=+29.855797660" watchObservedRunningTime="2026-07-12 17:03:01.653982853 +0000 UTC m=+29.855816087"
Jul 12 17:03:02.373781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.373597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:02.373984 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:02.373849    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:02.862659 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.862627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s75vp"]
Jul 12 17:03:02.863112 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.862742    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:02.863112 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:02.862839    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:03:02.866357 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.866319    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hphh"]
Jul 12 17:03:02.866481 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.866447    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:02.866569 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:02.866545    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:03:02.866997 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.866972    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x462c"]
Jul 12 17:03:02.867072 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:02.867060    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:02.867174 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:02.867155    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:03.612185 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:03.612153    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="6c11160350c13e0e368c8fbab2b66224caeaa50b95f47a0cb0d78b27a7a8f7e3" exitCode=0
Jul 12 17:03:03.612353 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:03.612238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"6c11160350c13e0e368c8fbab2b66224caeaa50b95f47a0cb0d78b27a7a8f7e3"}
Jul 12 17:03:04.374005 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:04.373965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:04.374749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:04.373967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:04.374749 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:04.374114    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:04.374749 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:04.374196    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:03:04.374749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:04.373967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:04.374749 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:04.374278    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:03:04.616370 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:04.616335    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerStarted","Data":"6211e5ede08b484d110721372f1033842127de75742827a4db68c77d11cb860a"}
Jul 12 17:03:05.620960 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:05.620744    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="6211e5ede08b484d110721372f1033842127de75742827a4db68c77d11cb860a" exitCode=0
Jul 12 17:03:05.620960 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:05.620833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"6211e5ede08b484d110721372f1033842127de75742827a4db68c77d11cb860a"}
Jul 12 17:03:06.070306 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.070217    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:06.070306 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.070266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.070311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070347    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070425    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret podName:f022beb1-077c-4449-b0d8-ef5d9897c525 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:38.070404354 +0000 UTC m=+66.272237589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret") pod "global-pull-secret-syncer-x462c" (UID: "f022beb1-077c-4449-b0d8-ef5d9897c525") : object "kube-system"/"original-pull-secret" not registered
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070438    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070452    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070457    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070471    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jxgr9 for pod openshift-network-diagnostics/network-check-target-s75vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:03:06.070519 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070519    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:38.070503867 +0000 UTC m=+66.272337108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 17:03:06.070899 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.070552    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9 podName:d794f6b0-ee38-42df-b981-207be62fc9f9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:38.070527228 +0000 UTC m=+66.272360480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxgr9" (UniqueName: "kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9") pod "network-check-target-s75vp" (UID: "d794f6b0-ee38-42df-b981-207be62fc9f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 17:03:06.373127 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.373042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:06.373127 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.373060    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:06.373127 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:06.373059    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:06.373409 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.373190    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:03:06.373409 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.373271    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:03:06.373409 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:06.373327    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:08.373529 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.373493    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:08.373942 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.373493    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:08.373942 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.373615    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:08.373942 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.373690    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hphh" podUID="6284bb2f-3b84-4586-92d0-ce568d42cb91"
Jul 12 17:03:08.373942 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.373598    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s75vp" podUID="d794f6b0-ee38-42df-b981-207be62fc9f9"
Jul 12 17:03:08.373942 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.373773    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x462c" podUID="f022beb1-077c-4449-b0d8-ef5d9897c525"
Jul 12 17:03:08.617102 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.617077    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-238.ec2.internal" event="NodeReady"
Jul 12 17:03:08.617275 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.617226    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 17:03:08.652802 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.652718    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:03:08.655755 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.655731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.658692 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.658670    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 17:03:08.658830 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.658751    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 17:03:08.658830 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.658823    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xrlpt\""
Jul 12 17:03:08.658968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.658844    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 17:03:08.664937 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.664918    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 17:03:08.671478 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.671389    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z4dk5"]
Jul 12 17:03:08.674643 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.674623    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:03:08.674747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.674734    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.676486 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.676468    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8jxs8"]
Jul 12 17:03:08.677540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.677518    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvzd7\""
Jul 12 17:03:08.678031 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.678011    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 17:03:08.678115 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.678035    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 17:03:08.682399 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.682377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.683540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.683518    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4dk5"]
Jul 12 17:03:08.684911 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.684892    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwq56\""
Jul 12 17:03:08.685734 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.685592    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 17:03:08.685734 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.685624    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 17:03:08.685734 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.685672    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 17:03:08.689061 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.689032    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8jxs8"]
Jul 12 17:03:08.791363 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791328    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791363 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvdq\" (UniqueName: \"kubernetes.io/projected/6708a039-3106-4d72-a749-d8503371e856-kube-api-access-4fvdq\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.791606 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791385    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf8d144-ae74-44b4-9abb-c71aecbfc765-cert\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.791606 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791606 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791606 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvk9p\" (UniqueName: \"kubernetes.io/projected/3cf8d144-ae74-44b4-9abb-c71aecbfc765-kube-api-access-tvk9p\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6708a039-3106-4d72-a749-d8503371e856-config-volume\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791782    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xrx\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.791817 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6708a039-3106-4d72-a749-d8503371e856-tmp-dir\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.792055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.792055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.791856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.892730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.892730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892783    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk9p\" (UniqueName: \"kubernetes.io/projected/3cf8d144-ae74-44b4-9abb-c71aecbfc765-kube-api-access-tvk9p\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6708a039-3106-4d72-a749-d8503371e856-config-volume\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.892902    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.892919    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:08.892973 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.892976    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:09.392958223 +0000 UTC m=+37.594791469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:08.893369 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.892906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xrx\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.893488 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6708a039-3106-4d72-a749-d8503371e856-tmp-dir\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.893488 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.893488 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.893660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.893660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvdq\" (UniqueName: \"kubernetes.io/projected/6708a039-3106-4d72-a749-d8503371e856-kube-api-access-4fvdq\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.893660 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.893532    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:08.893660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf8d144-ae74-44b4-9abb-c71aecbfc765-cert\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.893660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.893554    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.893910 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:08.893742    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:09.393687279 +0000 UTC m=+37.595520529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:08.894170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.894129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6708a039-3106-4d72-a749-d8503371e856-tmp-dir\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.894170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.894140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.894372 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.894328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6708a039-3106-4d72-a749-d8503371e856-config-volume\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.894565 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.894533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.897732 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.897708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.897834 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.897730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.897834 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.897737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf8d144-ae74-44b4-9abb-c71aecbfc765-cert\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.902735 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.902681    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvk9p\" (UniqueName: \"kubernetes.io/projected/3cf8d144-ae74-44b4-9abb-c71aecbfc765-kube-api-access-tvk9p\") pod \"ingress-canary-8jxs8\" (UID: \"3cf8d144-ae74-44b4-9abb-c71aecbfc765\") " pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:08.902735 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.902692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.902941 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.902830    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xrx\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:08.905047 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.905024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvdq\" (UniqueName: \"kubernetes.io/projected/6708a039-3106-4d72-a749-d8503371e856-kube-api-access-4fvdq\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:08.995609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:08.995573    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8jxs8"
Jul 12 17:03:09.397268 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:09.397225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:09.397275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:09.397367    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:09.397386    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:09.397449    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:10.397426232 +0000 UTC m=+38.599259468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:09.397462    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:09.397720 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:09.397541    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:10.397521553 +0000 UTC m=+38.599354803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:10.260339 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.260311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8jxs8"]
Jul 12 17:03:10.264283 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:10.264244    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf8d144_ae74_44b4_9abb_c71aecbfc765.slice/crio-b59f7fb6881fbf94786bfb013741053ae28cea067d10b2db8c64721f1ffbb796 WatchSource:0}: Error finding container b59f7fb6881fbf94786bfb013741053ae28cea067d10b2db8c64721f1ffbb796: Status 404 returned error can't find the container with id b59f7fb6881fbf94786bfb013741053ae28cea067d10b2db8c64721f1ffbb796
Jul 12 17:03:10.373392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.373204    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:10.373512 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.373215    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:10.373571 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.373262    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:10.376310 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.376295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 17:03:10.377473 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.377447    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wpssr\""
Jul 12 17:03:10.377473 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.377457    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 17:03:10.377807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.377477    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgjd4\""
Jul 12 17:03:10.377807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.377738    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 17:03:10.377937 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.377748    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 17:03:10.407186 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.407158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.407191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:10.407307    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:10.407367    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:12.407351093 +0000 UTC m=+40.609184328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:10.407310    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:10.407412    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:10.407641 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:10.407466    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:12.407451182 +0000 UTC m=+40.609284437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:10.635737 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.635654    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="12c7893539c858ace56b575009357b18c6bf18c64e1955095669791a183c0367" exitCode=0
Jul 12 17:03:10.635900 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.635732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"12c7893539c858ace56b575009357b18c6bf18c64e1955095669791a183c0367"}
Jul 12 17:03:10.636894 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:10.636875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8jxs8" event={"ID":"3cf8d144-ae74-44b4-9abb-c71aecbfc765","Type":"ContainerStarted","Data":"b59f7fb6881fbf94786bfb013741053ae28cea067d10b2db8c64721f1ffbb796"}
Jul 12 17:03:11.642186 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:11.642144    2584 generic.go:356] "Generic (PLEG): container finished" podID="4824959f-2ceb-4881-a948-d97585094606" containerID="dae18cd4d6e3514d275d4f547a7423a63a619bdb07940f9fa13074ad7137032d" exitCode=0
Jul 12 17:03:11.642612 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:11.642205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerDied","Data":"dae18cd4d6e3514d275d4f547a7423a63a619bdb07940f9fa13074ad7137032d"}
Jul 12 17:03:12.423331 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.423289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:12.423331 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.423330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:12.423549 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:12.423446    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:12.423549 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:12.423471    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:12.423549 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:12.423549    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:16.423528412 +0000 UTC m=+44.625361661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:12.423687 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:12.423457    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:12.423687 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:12.423586    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:16.423577625 +0000 UTC m=+44.625410862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:12.527624 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.527517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:12.648622 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.648586    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" event={"ID":"4824959f-2ceb-4881-a948-d97585094606","Type":"ContainerStarted","Data":"caba1db9486031c1752141079b5a7952ee8d589e3a5e0924043e684e763b7671"}
Jul 12 17:03:12.650927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.650898    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:12.676002 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.675941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ljxvg" podStartSLOduration=9.013341529 podStartE2EDuration="39.675919411s" totalImagesPullingTime="30.662577882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:12.674213189 +0000 UTC m=+40.876046450" watchObservedRunningTime="2026-07-12 17:03:12.675919411 +0000 UTC m=+40.877752670"
Jul 12 17:03:12.722856 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.722777    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:12.787784 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.787683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:12.888916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:12.888880    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.092712 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.092634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.162714 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.162674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.229067 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.228998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.486822 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.486779    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.588267 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.588224    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.652013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.651978    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8jxs8" event={"ID":"3cf8d144-ae74-44b4-9abb-c71aecbfc765","Type":"ContainerStarted","Data":"2eec2439f61d2535aa3a0e6d10cdae74f46c7d751ab867ea315326d0b19d229e"}
Jul 12 17:03:13.668389 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.668345    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8jxs8" podStartSLOduration=2.759542948 podStartE2EDuration="5.668330834s" totalImagesPullingTime="2.908787886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:13.668035185 +0000 UTC m=+41.869868442" watchObservedRunningTime="2026-07-12 17:03:13.668330834 +0000 UTC m=+41.870164091"
Jul 12 17:03:13.892603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.892567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:13.950242 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:13.950210    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:14.683513 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:14.683485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:14.738279 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:14.738245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:15.079307 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:15.079216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:15.131690 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:15.131660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:16.026280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:16.026241    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:16.126065 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:16.126030    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:16.451631 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:16.451598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:16.451826 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:16.451686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:16.451826 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:16.451744    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:16.451826 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:16.451787    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:16.451826 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:16.451799    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:16.451944 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:16.451828    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:24.451812101 +0000 UTC m=+52.653645356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:16.451944 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:16.451843    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:24.451837658 +0000 UTC m=+52.653670893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:19.868072 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.868034    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"]
Jul 12 17:03:19.892622 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.892593    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"]
Jul 12 17:03:19.892803 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.892725    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"
Jul 12 17:03:19.896683 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.896646    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 12 17:03:19.896813 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.896735    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bgbq5\""
Jul 12 17:03:19.896914 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.896901    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:19.906479 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.906461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"]
Jul 12 17:03:19.906568 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.906487    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"]
Jul 12 17:03:19.906568 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.906553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:19.912701 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.912679    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 12 17:03:19.912842 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.912826    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 12 17:03:19.912915 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.912899    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 12 17:03:19.912970 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.912950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:19.913027 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.912980    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-crwz5\""
Jul 12 17:03:19.973845 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.973814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262tr\" (UniqueName: \"kubernetes.io/projected/a2a34578-edca-44cc-b25f-46b4cf504258-kube-api-access-262tr\") pod \"volume-data-source-validator-78495597f6-wmfrm\" (UID: \"a2a34578-edca-44cc-b25f-46b4cf504258\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"
Jul 12 17:03:19.974001 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.973931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e046bc82-fccb-43ba-9460-b5ad8c40fd05-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:19.974001 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.973975    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e046bc82-fccb-43ba-9460-b5ad8c40fd05-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:19.974001 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:19.973997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q72rq\" (UniqueName: \"kubernetes.io/projected/e046bc82-fccb-43ba-9460-b5ad8c40fd05-kube-api-access-q72rq\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.019509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.019475    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"]
Jul 12 17:03:20.036443 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.036417    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s8c28"]
Jul 12 17:03:20.036610 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.036588    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.043753 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.043733    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.043897 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.043878    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7g8v7\""
Jul 12 17:03:20.043990 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.043974    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 12 17:03:20.051126 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.051110    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.062467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.062445    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"]
Jul 12 17:03:20.062582 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.062560    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.067276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.067258    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.067392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.067261    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.067793 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.067776    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 12 17:03:20.069007 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.068987    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 12 17:03:20.072840 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.072819    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mkvt9\""
Jul 12 17:03:20.074300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e046bc82-fccb-43ba-9460-b5ad8c40fd05-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.074438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.074438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074384    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-snapshots\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074421    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28kvz\" (UniqueName: \"kubernetes.io/projected/40986600-cf46-4088-8f29-8089fc155080-kube-api-access-28kvz\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79beeb21-6958-476f-b8e0-738d0e543390-serving-cert\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-tmp\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thtcq\" (UniqueName: \"kubernetes.io/projected/79beeb21-6958-476f-b8e0-738d0e543390-kube-api-access-thtcq\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e046bc82-fccb-43ba-9460-b5ad8c40fd05-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72rq\" (UniqueName: \"kubernetes.io/projected/e046bc82-fccb-43ba-9460-b5ad8c40fd05-kube-api-access-q72rq\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.074600 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.074970 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262tr\" (UniqueName: \"kubernetes.io/projected/a2a34578-edca-44cc-b25f-46b4cf504258-kube-api-access-262tr\") pod \"volume-data-source-validator-78495597f6-wmfrm\" (UID: \"a2a34578-edca-44cc-b25f-46b4cf504258\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"
Jul 12 17:03:20.074970 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.074894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e046bc82-fccb-43ba-9460-b5ad8c40fd05-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.077103 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.077084    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 12 17:03:20.078283 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.078267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e046bc82-fccb-43ba-9460-b5ad8c40fd05-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.082559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.082542    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-747fb75d5b-hc9gg"]
Jul 12 17:03:20.082559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.082555    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.086570 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.086555    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.087394 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.087379    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pcqmx\""
Jul 12 17:03:20.088923 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.088905    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 12 17:03:20.090991 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.090975    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 12 17:03:20.096081 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.096039    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.105745 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.105709    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q72rq\" (UniqueName: \"kubernetes.io/projected/e046bc82-fccb-43ba-9460-b5ad8c40fd05-kube-api-access-q72rq\") pod \"kube-storage-version-migrator-operator-799cb7f958-tvgmn\" (UID: \"e046bc82-fccb-43ba-9460-b5ad8c40fd05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.105903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.105884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-262tr\" (UniqueName: \"kubernetes.io/projected/a2a34578-edca-44cc-b25f-46b4cf504258-kube-api-access-262tr\") pod \"volume-data-source-validator-78495597f6-wmfrm\" (UID: \"a2a34578-edca-44cc-b25f-46b4cf504258\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"
Jul 12 17:03:20.108712 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.108694    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"]
Jul 12 17:03:20.108778 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.108730    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"]
Jul 12 17:03:20.108826 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.108811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.117086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117060    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 12 17:03:20.117086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117083    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 12 17:03:20.117291 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117273    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-md5zp\""
Jul 12 17:03:20.117349 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117331    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.117408 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117396    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 12 17:03:20.117482 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117467    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 12 17:03:20.117531 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.117471    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.128927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.128877    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s8c28"]
Jul 12 17:03:20.128927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.128905    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-747fb75d5b-hc9gg"]
Jul 12 17:03:20.128927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.128924    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"]
Jul 12 17:03:20.129074 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.128937    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"]
Jul 12 17:03:20.129074 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.128985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"
Jul 12 17:03:20.132278 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.132262    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6ts7c\""
Jul 12 17:03:20.147031 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.147010    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"]
Jul 12 17:03:20.165036 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.165009    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.165369 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.165350    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9txd"]
Jul 12 17:03:20.168184 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.168163    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 12 17:03:20.168279 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.168198    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 12 17:03:20.168629 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.168616    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8msfv\""
Jul 12 17:03:20.171215 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.171058    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.172044 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.171878    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.175500 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.175585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175507    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thtcq\" (UniqueName: \"kubernetes.io/projected/79beeb21-6958-476f-b8e0-738d0e543390-kube-api-access-thtcq\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.175585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9sc\" (UniqueName: \"kubernetes.io/projected/4aea25b8-c139-4ac3-8a88-22ac9284b52e-kube-api-access-ps9sc\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.175585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlj5d\" (UniqueName: \"kubernetes.io/projected/b92fc86a-278e-445a-b069-0817ab59a76c-kube-api-access-mlj5d\") pod \"network-check-source-869dcfcdcd-2f6bt\" (UID: \"b92fc86a-278e-445a-b069-0817ab59a76c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"
Jul 12 17:03:20.175585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9vsh\" (UniqueName: \"kubernetes.io/projected/ab429711-deb3-47be-8df4-3054a0680b29-kube-api-access-h9vsh\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.175752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-tmp\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.175752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28kvz\" (UniqueName: \"kubernetes.io/projected/40986600-cf46-4088-8f29-8089fc155080-kube-api-access-28kvz\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.175842 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-snapshots\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.175842 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79beeb21-6958-476f-b8e0-738d0e543390-serving-cert\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.175944 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-default-certificate\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.175987 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.176030 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.175996    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.176075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.176075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176042    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-tmp\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.176075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aea25b8-c139-4ac3-8a88-22ac9284b52e-config\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.176204 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtlq\" (UniqueName: \"kubernetes.io/projected/179a6916-ac30-4a38-8283-0dbbb8404fbd-kube-api-access-lmtlq\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.176204 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.176279 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab429711-deb3-47be-8df4-3054a0680b29-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.176320 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.176320 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176299    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-stats-auth\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.176414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aea25b8-c139-4ac3-8a88-22ac9284b52e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.176414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.176414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79beeb21-6958-476f-b8e0-738d0e543390-snapshots\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.176414 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.176373    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 17:03:20.176549 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.176442    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls podName:40986600-cf46-4088-8f29-8089fc155080 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:20.676423004 +0000 UTC m=+48.878256244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls") pod "cluster-samples-operator-65db858894-bl2rt" (UID: "40986600-cf46-4088-8f29-8089fc155080") : secret "samples-operator-tls" not found
Jul 12 17:03:20.176846 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.176828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79beeb21-6958-476f-b8e0-738d0e543390-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.178116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.178100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79beeb21-6958-476f-b8e0-738d0e543390-serving-cert\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.191153 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.191131    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"]
Jul 12 17:03:20.191248 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.191160    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-pzm79"]
Jul 12 17:03:20.191295 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.191244    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.194384 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.194356    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-46v2b\""
Jul 12 17:03:20.194933 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.194908    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 12 17:03:20.195451 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.195438    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 12 17:03:20.195837 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.195819    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thtcq\" (UniqueName: \"kubernetes.io/projected/79beeb21-6958-476f-b8e0-738d0e543390-kube-api-access-thtcq\") pod \"insights-operator-68d9dd94cf-s8c28\" (UID: \"79beeb21-6958-476f-b8e0-738d0e543390\") " pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.200840 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.200820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"
Jul 12 17:03:20.203435 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.203415    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28kvz\" (UniqueName: \"kubernetes.io/projected/40986600-cf46-4088-8f29-8089fc155080-kube-api-access-28kvz\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.209434 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.209391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9txd"]
Jul 12 17:03:20.209541 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.209494    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.210349 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.210332    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-pzm79"]
Jul 12 17:03:20.213447 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213424    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 12 17:03:20.213649 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213623    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:20.213806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213709    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 12 17:03:20.213806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213730    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 12 17:03:20.213806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213712    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d27bc\""
Jul 12 17:03:20.214011 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.213862    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"
Jul 12 17:03:20.221150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.220749    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276788    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-stats-auth\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aea25b8-c139-4ac3-8a88-22ac9284b52e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b88f1c8-6213-4002-95bc-6d813a8a9379-serving-cert\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9sc\" (UniqueName: \"kubernetes.io/projected/4aea25b8-c139-4ac3-8a88-22ac9284b52e-kube-api-access-ps9sc\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlj5d\" (UniqueName: \"kubernetes.io/projected/b92fc86a-278e-445a-b069-0817ab59a76c-kube-api-access-mlj5d\") pod \"network-check-source-869dcfcdcd-2f6bt\" (UID: \"b92fc86a-278e-445a-b069-0817ab59a76c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.276990    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-trusted-ca\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9vsh\" (UniqueName: \"kubernetes.io/projected/ab429711-deb3-47be-8df4-3054a0680b29-kube-api-access-h9vsh\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-default-certificate\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cad6402-e9c7-42bb-9da0-153633513406-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277211    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-config\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.279315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aea25b8-c139-4ac3-8a88-22ac9284b52e-config\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l67tq\" (UniqueName: \"kubernetes.io/projected/3b88f1c8-6213-4002-95bc-6d813a8a9379-kube-api-access-l67tq\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtlq\" (UniqueName: \"kubernetes.io/projected/179a6916-ac30-4a38-8283-0dbbb8404fbd-kube-api-access-lmtlq\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.277340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab429711-deb3-47be-8df4-3054a0680b29-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.277489    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.277557    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:20.777533431 +0000 UTC m=+48.979366686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.277960    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.278049    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:20.778030682 +0000 UTC m=+48.979863923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.278135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab429711-deb3-47be-8df4-3054a0680b29-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.278267    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:20.778251459 +0000 UTC m=+48.980084694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:20.280603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.278804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4aea25b8-c139-4ac3-8a88-22ac9284b52e-config\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.282077 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.281542    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4aea25b8-c139-4ac3-8a88-22ac9284b52e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.282077 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.281984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-default-certificate\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.282077 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.282039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-stats-auth\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.293738 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.293702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9vsh\" (UniqueName: \"kubernetes.io/projected/ab429711-deb3-47be-8df4-3054a0680b29-kube-api-access-h9vsh\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.303263 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.299203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlj5d\" (UniqueName: \"kubernetes.io/projected/b92fc86a-278e-445a-b069-0817ab59a76c-kube-api-access-mlj5d\") pod \"network-check-source-869dcfcdcd-2f6bt\" (UID: \"b92fc86a-278e-445a-b069-0817ab59a76c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"
Jul 12 17:03:20.303263 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.303048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtlq\" (UniqueName: \"kubernetes.io/projected/179a6916-ac30-4a38-8283-0dbbb8404fbd-kube-api-access-lmtlq\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.305301 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.305274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9sc\" (UniqueName: \"kubernetes.io/projected/4aea25b8-c139-4ac3-8a88-22ac9284b52e-kube-api-access-ps9sc\") pod \"service-ca-operator-7695fc6c8c-q7nxd\" (UID: \"4aea25b8-c139-4ac3-8a88-22ac9284b52e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.332618 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.332576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:20.370014 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.369975    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm"]
Jul 12 17:03:20.372430 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.372410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28"
Jul 12 17:03:20.372779 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.372742    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a34578_edca_44cc_b25f_46b4cf504258.slice/crio-47bc807e4db0410c7561502173a4ed826fb5099dd1ab176e4122f710f905b1d2 WatchSource:0}: Error finding container 47bc807e4db0410c7561502173a4ed826fb5099dd1ab176e4122f710f905b1d2: Status 404 returned error can't find the container with id 47bc807e4db0410c7561502173a4ed826fb5099dd1ab176e4122f710f905b1d2
Jul 12 17:03:20.378329 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cad6402-e9c7-42bb-9da0-153633513406-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.378425 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378332    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-config\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.378425 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l67tq\" (UniqueName: \"kubernetes.io/projected/3b88f1c8-6213-4002-95bc-6d813a8a9379-kube-api-access-l67tq\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.378568 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b88f1c8-6213-4002-95bc-6d813a8a9379-serving-cert\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.378700 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.378700 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.378628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-trusted-ca\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.378893 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.378718    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:20.378893 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.378853    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:20.878808368 +0000 UTC m=+49.080641603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:20.379108 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.379065    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-config\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.379108 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.379080    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cad6402-e9c7-42bb-9da0-153633513406-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.379664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.379647    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b88f1c8-6213-4002-95bc-6d813a8a9379-trusted-ca\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.380750 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.380732    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b88f1c8-6213-4002-95bc-6d813a8a9379-serving-cert\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.388398 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.388378    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn"]
Jul 12 17:03:20.391090 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.391063    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode046bc82_fccb_43ba_9460_b5ad8c40fd05.slice/crio-8957fb7af090b1fb0a29f1dac535fc230c4eda8a6b67607ad720e4033fd489fb WatchSource:0}: Error finding container 8957fb7af090b1fb0a29f1dac535fc230c4eda8a6b67607ad720e4033fd489fb: Status 404 returned error can't find the container with id 8957fb7af090b1fb0a29f1dac535fc230c4eda8a6b67607ad720e4033fd489fb
Jul 12 17:03:20.392540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.392522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l67tq\" (UniqueName: \"kubernetes.io/projected/3b88f1c8-6213-4002-95bc-6d813a8a9379-kube-api-access-l67tq\") pod \"console-operator-7866497494-pzm79\" (UID: \"3b88f1c8-6213-4002-95bc-6d813a8a9379\") " pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.430961 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.430925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:20.437306 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.436931    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"
Jul 12 17:03:20.475070 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.475041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"
Jul 12 17:03:20.490832 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.490794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:20.522707 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.522415    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:20.525209 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.525180    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s8c28"]
Jul 12 17:03:20.528638 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.528431    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79beeb21_6958_476f_b8e0_738d0e543390.slice/crio-7c9117c308e273aa66f743596dce148cd8679a2d6e194fa0718a6c55ff73e591 WatchSource:0}: Error finding container 7c9117c308e273aa66f743596dce148cd8679a2d6e194fa0718a6c55ff73e591: Status 404 returned error can't find the container with id 7c9117c308e273aa66f743596dce148cd8679a2d6e194fa0718a6c55ff73e591
Jul 12 17:03:20.615561 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.615474    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt"]
Jul 12 17:03:20.619258 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.619220    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92fc86a_278e_445a_b069_0817ab59a76c.slice/crio-d2c83d4a730b0b451f3d835d51021a365e1d261c5ce04fb9af0cdb8b36e0c12f WatchSource:0}: Error finding container d2c83d4a730b0b451f3d835d51021a365e1d261c5ce04fb9af0cdb8b36e0c12f: Status 404 returned error can't find the container with id d2c83d4a730b0b451f3d835d51021a365e1d261c5ce04fb9af0cdb8b36e0c12f
Jul 12 17:03:20.642586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.642511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd"]
Jul 12 17:03:20.645669 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.645634    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aea25b8_c139_4ac3_8a88_22ac9284b52e.slice/crio-6f87222d1f5adbd374a0b9906d54d3451c313ca9d1b6ff09820961b02286ea3f WatchSource:0}: Error finding container 6f87222d1f5adbd374a0b9906d54d3451c313ca9d1b6ff09820961b02286ea3f: Status 404 returned error can't find the container with id 6f87222d1f5adbd374a0b9906d54d3451c313ca9d1b6ff09820961b02286ea3f
Jul 12 17:03:20.668322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.668288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn" event={"ID":"e046bc82-fccb-43ba-9460-b5ad8c40fd05","Type":"ContainerStarted","Data":"8957fb7af090b1fb0a29f1dac535fc230c4eda8a6b67607ad720e4033fd489fb"}
Jul 12 17:03:20.669424 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.669398    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt" event={"ID":"b92fc86a-278e-445a-b069-0817ab59a76c","Type":"ContainerStarted","Data":"d2c83d4a730b0b451f3d835d51021a365e1d261c5ce04fb9af0cdb8b36e0c12f"}
Jul 12 17:03:20.670564 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.670399    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28" event={"ID":"79beeb21-6958-476f-b8e0-738d0e543390","Type":"ContainerStarted","Data":"7c9117c308e273aa66f743596dce148cd8679a2d6e194fa0718a6c55ff73e591"}
Jul 12 17:03:20.671605 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.671580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd" event={"ID":"4aea25b8-c139-4ac3-8a88-22ac9284b52e","Type":"ContainerStarted","Data":"6f87222d1f5adbd374a0b9906d54d3451c313ca9d1b6ff09820961b02286ea3f"}
Jul 12 17:03:20.672751 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.672731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm" event={"ID":"a2a34578-edca-44cc-b25f-46b4cf504258","Type":"ContainerStarted","Data":"47bc807e4db0410c7561502173a4ed826fb5099dd1ab176e4122f710f905b1d2"}
Jul 12 17:03:20.681236 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.681216    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:20.681365 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.681348    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 17:03:20.681425 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.681414    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls podName:40986600-cf46-4088-8f29-8089fc155080 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:21.681394847 +0000 UTC m=+49.883228082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls") pod "cluster-samples-operator-65db858894-bl2rt" (UID: "40986600-cf46-4088-8f29-8089fc155080") : secret "samples-operator-tls" not found
Jul 12 17:03:20.693612 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.693589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-pzm79"]
Jul 12 17:03:20.705747 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:20.705722    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b88f1c8_6213_4002_95bc_6d813a8a9379.slice/crio-d2935d8cdaa17b7517ebfb8ce8d8e1b8f4b540df8ae32efd3e139acc286dc6a0 WatchSource:0}: Error finding container d2935d8cdaa17b7517ebfb8ce8d8e1b8f4b540df8ae32efd3e139acc286dc6a0: Status 404 returned error can't find the container with id d2935d8cdaa17b7517ebfb8ce8d8e1b8f4b540df8ae32efd3e139acc286dc6a0
Jul 12 17:03:20.781929 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.781891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:20.782117 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.781940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.782117 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.782015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:20.782117 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.782074    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:20.782295 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.782141    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:21.782121415 +0000 UTC m=+49.983954672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:20.782295 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.782159    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:20.782295 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.782165    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:21.782154988 +0000 UTC m=+49.983988230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:20.782295 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.782194    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:21.782184043 +0000 UTC m=+49.984017280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:20.882966 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:20.882829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:20.882966 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.882958    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:20.883464 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:20.883043    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:21.883011264 +0000 UTC m=+50.084844504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:21.680585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.680501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pzm79" event={"ID":"3b88f1c8-6213-4002-95bc-6d813a8a9379","Type":"ContainerStarted","Data":"d2935d8cdaa17b7517ebfb8ce8d8e1b8f4b540df8ae32efd3e139acc286dc6a0"}
Jul 12 17:03:21.691401 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.690717    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:21.691401 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.691014    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 17:03:21.691401 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.691156    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls podName:40986600-cf46-4088-8f29-8089fc155080 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:23.69105871 +0000 UTC m=+51.892891968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls") pod "cluster-samples-operator-65db858894-bl2rt" (UID: "40986600-cf46-4088-8f29-8089fc155080") : secret "samples-operator-tls" not found
Jul 12 17:03:21.791729 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.791691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:21.791922 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.791849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:21.791922 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.791891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:21.791922 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.791907    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:21.792100 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.791978    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:23.791958975 +0000 UTC m=+51.993792222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:21.792100 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.792009    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:23.791993473 +0000 UTC m=+51.993826711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:21.792100 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.792079    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:21.792266 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.792115    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:23.792103339 +0000 UTC m=+51.993936576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:21.892584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:21.892548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:21.893072 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.892718    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:21.893072 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:21.892814    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:23.892791844 +0000 UTC m=+52.094625079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:23.712206 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:23.712159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:23.712682 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.712331    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 17:03:23.712682 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.712416    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls podName:40986600-cf46-4088-8f29-8089fc155080 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:27.712392661 +0000 UTC m=+55.914225899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls") pod "cluster-samples-operator-65db858894-bl2rt" (UID: "40986600-cf46-4088-8f29-8089fc155080") : secret "samples-operator-tls" not found
Jul 12 17:03:23.813536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:23.813501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:23.813719 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:23.813548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:23.813719 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:23.813624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:23.813719 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.813706    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:23.813888 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.813788    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:27.813751102 +0000 UTC m=+56.015584347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:23.813888 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.813716    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:23.813888 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.813810    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:27.813803092 +0000 UTC m=+56.015636327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:23.813888 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.813834    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:27.813822522 +0000 UTC m=+56.015655756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:23.915201 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:23.915148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:23.915377 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.915329    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:23.915447 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:23.915410    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:27.915389202 +0000 UTC m=+56.117222444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:24.521955 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:24.521912    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:24.522112 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:24.521982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:24.522112 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:24.522083    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 17:03:24.522112 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:24.522097    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65bb47595-q77p7: secret "image-registry-tls" not found
Jul 12 17:03:24.522214 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:24.522139    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 17:03:24.522214 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:24.522148    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls podName:ecb439ff-23c8-469e-92b5-ff26f2c809fb nodeName:}" failed. No retries permitted until 2026-07-12 17:03:40.522133865 +0000 UTC m=+68.723967103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls") pod "image-registry-65bb47595-q77p7" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb") : secret "image-registry-tls" not found
Jul 12 17:03:24.522214 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:24.522198    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls podName:6708a039-3106-4d72-a749-d8503371e856 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:40.522184956 +0000 UTC m=+68.724018191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls") pod "dns-default-z4dk5" (UID: "6708a039-3106-4d72-a749-d8503371e856") : secret "dns-default-metrics-tls" not found
Jul 12 17:03:26.696946 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.696813    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm" event={"ID":"a2a34578-edca-44cc-b25f-46b4cf504258","Type":"ContainerStarted","Data":"95cc127cb703f124c8915b548ebf1846e9155d5fa8cc98946161afca5d323d98"}
Jul 12 17:03:26.699038 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.699004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn" event={"ID":"e046bc82-fccb-43ba-9460-b5ad8c40fd05","Type":"ContainerStarted","Data":"15852d2e099c82fbbd07b5933b0a97b9cac33c4859428fa122459f99211a9386"}
Jul 12 17:03:26.701860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.701238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pzm79" event={"ID":"3b88f1c8-6213-4002-95bc-6d813a8a9379","Type":"ContainerStarted","Data":"f3cf36391ce30a6a762d075038938bac8a65c6cdd8ce1db6b57d6f23934fcd54"}
Jul 12 17:03:26.701860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.701785    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:26.703238 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.703198    2584 patch_prober.go:28] interesting pod/console-operator-7866497494-pzm79 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 12 17:03:26.703335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.703255    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-pzm79" podUID="3b88f1c8-6213-4002-95bc-6d813a8a9379" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 12 17:03:26.704132 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.704110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt" event={"ID":"b92fc86a-278e-445a-b069-0817ab59a76c","Type":"ContainerStarted","Data":"004669d78068902a99dfa1e708db0a4aa597d83d4402c910ff406a6a97309cc8"}
Jul 12 17:03:26.706592 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.706291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28" event={"ID":"79beeb21-6958-476f-b8e0-738d0e543390","Type":"ContainerStarted","Data":"786c0a2aa0575ac4ad980f763a23938f5bf880aba18dc4d02b41f6f0a9fe3b4d"}
Jul 12 17:03:26.707932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.707908    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd" event={"ID":"4aea25b8-c139-4ac3-8a88-22ac9284b52e","Type":"ContainerStarted","Data":"5b56cb88d77c2a4172d5a181d9bc343b119e6a53b432508d7c16bcc3bce02e96"}
Jul 12 17:03:26.715536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.715491    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wmfrm" podStartSLOduration=1.7269468799999999 podStartE2EDuration="7.715473985s" totalImagesPullingTime="5.988527105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.714937104 +0000 UTC m=+54.916770366" watchObservedRunningTime="2026-07-12 17:03:26.715473985 +0000 UTC m=+54.917307244"
Jul 12 17:03:26.733533 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.733479    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-pzm79" podStartSLOduration=1.00937993 podStartE2EDuration="6.733460817s" totalImagesPullingTime="5.724080887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.733457639 +0000 UTC m=+54.935290904" watchObservedRunningTime="2026-07-12 17:03:26.733460817 +0000 UTC m=+54.935294076"
Jul 12 17:03:26.752896 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.752837    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28" podStartSLOduration=1.857890379 podStartE2EDuration="7.752821348s" totalImagesPullingTime="5.894930969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.752251212 +0000 UTC m=+54.954084470" watchObservedRunningTime="2026-07-12 17:03:26.752821348 +0000 UTC m=+54.954654606"
Jul 12 17:03:26.771682 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.771428    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn" podStartSLOduration=1.7390894559999999 podStartE2EDuration="7.771405714s" totalImagesPullingTime="6.032316258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.770242985 +0000 UTC m=+54.972076234" watchObservedRunningTime="2026-07-12 17:03:26.771405714 +0000 UTC m=+54.973238972"
Jul 12 17:03:26.790417 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.790346    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd" podStartSLOduration=1.012115128 podStartE2EDuration="6.790333121s" totalImagesPullingTime="5.778217993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.789952346 +0000 UTC m=+54.991785605" watchObservedRunningTime="2026-07-12 17:03:26.790333121 +0000 UTC m=+54.992166386"
Jul 12 17:03:26.828538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:26.828496    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:27.713670 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.713644    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/0.log"
Jul 12 17:03:27.714154 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.713682    2584 generic.go:356] "Generic (PLEG): container finished" podID="3b88f1c8-6213-4002-95bc-6d813a8a9379" containerID="f3cf36391ce30a6a762d075038938bac8a65c6cdd8ce1db6b57d6f23934fcd54" exitCode=255
Jul 12 17:03:27.714154 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.713791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pzm79" event={"ID":"3b88f1c8-6213-4002-95bc-6d813a8a9379","Type":"ContainerDied","Data":"f3cf36391ce30a6a762d075038938bac8a65c6cdd8ce1db6b57d6f23934fcd54"}
Jul 12 17:03:27.714154 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.714021    2584 scope.go:117] "RemoveContainer" containerID="f3cf36391ce30a6a762d075038938bac8a65c6cdd8ce1db6b57d6f23934fcd54"
Jul 12 17:03:27.733184 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.733132    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f6bt" podStartSLOduration=2.930944014 podStartE2EDuration="8.733111444s" totalImagesPullingTime="5.80216743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:26.808751841 +0000 UTC m=+55.010585099" watchObservedRunningTime="2026-07-12 17:03:27.733111444 +0000 UTC m=+55.934944702"
Jul 12 17:03:27.753825 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.752943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:27.753825 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.753299    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 17:03:27.753825 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.753360    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls podName:40986600-cf46-4088-8f29-8089fc155080 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.753340894 +0000 UTC m=+63.955174132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls") pod "cluster-samples-operator-65db858894-bl2rt" (UID: "40986600-cf46-4088-8f29-8089fc155080") : secret "samples-operator-tls" not found
Jul 12 17:03:27.854650 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.854615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:27.854790 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.854676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:27.854790 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.854781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:27.854905 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.854783    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:27.854905 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.854856    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.854835149 +0000 UTC m=+64.056668394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:27.854905 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.854868    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:27.854905 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.854870    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.854864083 +0000 UTC m=+64.056697322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:27.855071 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.855011    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.854988674 +0000 UTC m=+64.056821915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:27.915467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.915419    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:27.930823 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.930791    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"]
Jul 12 17:03:27.932785 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.932755    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"
Jul 12 17:03:27.935801 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.935778    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 12 17:03:27.936722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.936193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xvrf5\""
Jul 12 17:03:27.936722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.936518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 12 17:03:27.945063 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.945042    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"]
Jul 12 17:03:27.956177 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:27.956151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:27.956331 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.956313    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:27.956400 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:27.956388    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.956366077 +0000 UTC m=+64.158199315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:28.003717 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.003627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.056958 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.056924    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqrrp\" (UniqueName: \"kubernetes.io/projected/a2cc183b-751a-42d9-92ba-ed2ce07173e4-kube-api-access-gqrrp\") pod \"migrator-7f59b54f6c-88knx\" (UID: \"a2cc183b-751a-42d9-92ba-ed2ce07173e4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"
Jul 12 17:03:28.103702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.103666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.158182 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.158008    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqrrp\" (UniqueName: \"kubernetes.io/projected/a2cc183b-751a-42d9-92ba-ed2ce07173e4-kube-api-access-gqrrp\") pod \"migrator-7f59b54f6c-88knx\" (UID: \"a2cc183b-751a-42d9-92ba-ed2ce07173e4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"
Jul 12 17:03:28.171580 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.171541    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqrrp\" (UniqueName: \"kubernetes.io/projected/a2cc183b-751a-42d9-92ba-ed2ce07173e4-kube-api-access-gqrrp\") pod \"migrator-7f59b54f6c-88knx\" (UID: \"a2cc183b-751a-42d9-92ba-ed2ce07173e4\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"
Jul 12 17:03:28.188664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.187194    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zltng"]
Jul 12 17:03:28.190147 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.190123    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.193185 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.193160    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 17:03:28.193348 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.193331    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vs9jl\""
Jul 12 17:03:28.193436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.193412    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 17:03:28.201186 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.201164    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zltng"]
Jul 12 17:03:28.210044 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.210004    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.242533 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.242501    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"
Jul 12 17:03:28.258942 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.258857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.259079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.258952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9bb4a5-1579-4068-937d-d620c91fa0d9-data-volume\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.259079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.258988    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.259079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.259043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhxz\" (UniqueName: \"kubernetes.io/projected/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-api-access-xxhxz\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.259079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.259071    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b9bb4a5-1579-4068-937d-d620c91fa0d9-crio-socket\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.267348 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.267277    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.359435 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359395    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b9bb4a5-1579-4068-937d-d620c91fa0d9-crio-socket\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359435 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359639 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b9bb4a5-1579-4068-937d-d620c91fa0d9-crio-socket\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359639 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.359555    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 17:03:28.359639 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.359619    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:28.859601429 +0000 UTC m=+57.061434687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : configmap "kube-rbac-proxy" not found
Jul 12 17:03:28.359820 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9bb4a5-1579-4068-937d-d620c91fa0d9-data-volume\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359820 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359677    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359820 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhxz\" (UniqueName: \"kubernetes.io/projected/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-api-access-xxhxz\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.359963 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.359856    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:28.359963 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.359906    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:28.8598921 +0000 UTC m=+57.061725340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:28.360064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.359993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b9bb4a5-1579-4068-937d-d620c91fa0d9-data-volume\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.367271 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.367249    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhxz\" (UniqueName: \"kubernetes.io/projected/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-api-access-xxhxz\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.369707 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.369687    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx"]
Jul 12 17:03:28.372014 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:28.371983    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2cc183b_751a_42d9_92ba_ed2ce07173e4.slice/crio-9a6e7bde0439f531e698118f4fb46476f9b558fd201c66daa924b4156dd7c4f4 WatchSource:0}: Error finding container 9a6e7bde0439f531e698118f4fb46476f9b558fd201c66daa924b4156dd7c4f4: Status 404 returned error can't find the container with id 9a6e7bde0439f531e698118f4fb46476f9b558fd201c66daa924b4156dd7c4f4
Jul 12 17:03:28.666693 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.666660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.723049 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.723005    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx" event={"ID":"a2cc183b-751a-42d9-92ba-ed2ce07173e4","Type":"ContainerStarted","Data":"9a6e7bde0439f531e698118f4fb46476f9b558fd201c66daa924b4156dd7c4f4"}
Jul 12 17:03:28.724806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.724782    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:03:28.725239 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.725219    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/0.log"
Jul 12 17:03:28.725322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.725263    2584 generic.go:356] "Generic (PLEG): container finished" podID="3b88f1c8-6213-4002-95bc-6d813a8a9379" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1" exitCode=255
Jul 12 17:03:28.725322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.725308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pzm79" event={"ID":"3b88f1c8-6213-4002-95bc-6d813a8a9379","Type":"ContainerDied","Data":"558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"}
Jul 12 17:03:28.725424 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.725358    2584 scope.go:117] "RemoveContainer" containerID="f3cf36391ce30a6a762d075038938bac8a65c6cdd8ce1db6b57d6f23934fcd54"
Jul 12 17:03:28.725616 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.725601    2584 scope.go:117] "RemoveContainer" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"
Jul 12 17:03:28.725850 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.725816    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pzm79_openshift-console-operator(3b88f1c8-6213-4002-95bc-6d813a8a9379)\"" pod="openshift-console-operator/console-operator-7866497494-pzm79" podUID="3b88f1c8-6213-4002-95bc-6d813a8a9379"
Jul 12 17:03:28.748239 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.748206    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:28.864189 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.864156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.864394 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:28.864318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:28.864394 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.864330    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:28.864507 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.864392    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 17:03:28.864507 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.864411    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:29.86438833 +0000 UTC m=+58.066221571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:28.864507 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:28.864447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:29.864431488 +0000 UTC m=+58.066264737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : configmap "kube-rbac-proxy" not found
Jul 12 17:03:29.729754 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.729714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx" event={"ID":"a2cc183b-751a-42d9-92ba-ed2ce07173e4","Type":"ContainerStarted","Data":"1b2575e15b13a687d84d1909a92a775d7872d28450fe6ac1d56d76102f9070ca"}
Jul 12 17:03:29.730213 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.729809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx" event={"ID":"a2cc183b-751a-42d9-92ba-ed2ce07173e4","Type":"ContainerStarted","Data":"bee56cca83e556565c42bb3971bc324609a652275e774a41076bff7a8c0c0dd6"}
Jul 12 17:03:29.731257 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.731237    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:03:29.731578 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.731561    2584 scope.go:117] "RemoveContainer" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"
Jul 12 17:03:29.731747 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:29.731727    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pzm79_openshift-console-operator(3b88f1c8-6213-4002-95bc-6d813a8a9379)\"" pod="openshift-console-operator/console-operator-7866497494-pzm79" podUID="3b88f1c8-6213-4002-95bc-6d813a8a9379"
Jul 12 17:03:29.751482 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.751436    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-88knx" podStartSLOduration=1.820689873 podStartE2EDuration="2.751420513s" totalImagesPullingTime="930.73064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:29.750688532 +0000 UTC m=+57.952521789" watchObservedRunningTime="2026-07-12 17:03:29.751420513 +0000 UTC m=+57.953253770"
Jul 12 17:03:29.836433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.836399    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:29.876084 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.876055    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:29.876248 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:29.876168    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 17:03:29.876248 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:29.876198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:29.876248 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:29.876225    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:31.87621044 +0000 UTC m=+60.078043674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : configmap "kube-rbac-proxy" not found
Jul 12 17:03:29.876421 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:29.876300    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:29.876421 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:29.876359    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:31.8763432 +0000 UTC m=+60.078176441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:30.177408 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.177380    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsdxt_6a2bf471-5e6a-4800-add6-0cd85482041f/dns-node-resolver/0.log"
Jul 12 17:03:30.248345 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.248314    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vnjz4"]
Jul 12 17:03:30.251414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.251396    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.254856 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.254832    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 12 17:03:30.255091 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.255077    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 12 17:03:30.255161 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.255144    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2tqqb\""
Jul 12 17:03:30.255400 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.255385    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 12 17:03:30.255982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.255965    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 12 17:03:30.266232 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.266211    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vnjz4"]
Jul 12 17:03:30.294114 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.294080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:30.372695 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.372661    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:30.380314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.380280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-key\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.380314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.380313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-cabundle\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.380473 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.380379    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8f29\" (UniqueName: \"kubernetes.io/projected/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-kube-api-access-x8f29\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.481042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.480951    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-key\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.481042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.480989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-cabundle\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.481042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.481007    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8f29\" (UniqueName: \"kubernetes.io/projected/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-kube-api-access-x8f29\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.481635 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.481613    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-cabundle\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.483400 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.483378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-signing-key\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.490628 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.490607    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8f29\" (UniqueName: \"kubernetes.io/projected/3a3efa2a-e9d4-4b90-9569-e80b81b9d19e-kube-api-access-x8f29\") pod \"service-ca-79f68b9f4f-vnjz4\" (UID: \"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.523504 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.523463    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:30.560306 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.560275    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4"
Jul 12 17:03:30.691892 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.691718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vnjz4"]
Jul 12 17:03:30.694412 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:30.694380    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3efa2a_e9d4_4b90_9569_e80b81b9d19e.slice/crio-0b8c2338b568f313dbbb942c593c6ae853a628c41be642e41bf0d6d1f795173a WatchSource:0}: Error finding container 0b8c2338b568f313dbbb942c593c6ae853a628c41be642e41bf0d6d1f795173a: Status 404 returned error can't find the container with id 0b8c2338b568f313dbbb942c593c6ae853a628c41be642e41bf0d6d1f795173a
Jul 12 17:03:30.735549 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.735515    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4" event={"ID":"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e","Type":"ContainerStarted","Data":"0b8c2338b568f313dbbb942c593c6ae853a628c41be642e41bf0d6d1f795173a"}
Jul 12 17:03:30.736013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.735995    2584 scope.go:117] "RemoveContainer" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"
Jul 12 17:03:30.736171 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:30.736151    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pzm79_openshift-console-operator(3b88f1c8-6213-4002-95bc-6d813a8a9379)\"" pod="openshift-console-operator/console-operator-7866497494-pzm79" podUID="3b88f1c8-6213-4002-95bc-6d813a8a9379"
Jul 12 17:03:30.978231 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:30.978203    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cgc76_d61dc20c-65cc-4d35-a1f8-614b6c2c8abb/node-ca/0.log"
Jul 12 17:03:31.291910 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.291856    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:31.740392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.740351    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4" event={"ID":"3a3efa2a-e9d4-4b90-9569-e80b81b9d19e","Type":"ContainerStarted","Data":"7b4d19757bb7955f1adcb93cd24ad1bb44f11648185e7cca272ecee658a964b9"}
Jul 12 17:03:31.763131 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.763081    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-vnjz4" podStartSLOduration=1.7630665730000001 podStartE2EDuration="1.763066573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:31.763044611 +0000 UTC m=+59.964877868" watchObservedRunningTime="2026-07-12 17:03:31.763066573 +0000 UTC m=+59.964899830"
Jul 12 17:03:31.780530 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.780501    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8jxs8_3cf8d144-ae74-44b4-9abb-c71aecbfc765/serve-healthcheck-canary/0.log"
Jul 12 17:03:31.897133 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.897093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:31.897333 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.897191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:31.897333 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:31.897257    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:31.897333 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:31.897299    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 17:03:31.897464 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:31.897342    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.89732087 +0000 UTC m=+64.099154120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:31.897464 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:31.897363    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:35.897353185 +0000 UTC m=+64.099186419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : configmap "kube-rbac-proxy" not found
Jul 12 17:03:31.978840 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:31.978808    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-88knx_a2cc183b-751a-42d9-92ba-ed2ce07173e4/migrator/0.log"
Jul 12 17:03:32.178048 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.178016    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-88knx_a2cc183b-751a-42d9-92ba-ed2ce07173e4/graceful-termination/0.log"
Jul 12 17:03:32.182191 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.182150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.321646 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.321612    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.387029 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.386958    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tvgmn_e046bc82-fccb-43ba-9460-b5ad8c40fd05/kube-storage-version-migrator-operator/0.log"
Jul 12 17:03:32.471565 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.471472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.571406 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.571366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.686425 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.686386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.762807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.762695    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:32.882475 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:32.882439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:33.482270 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:33.482237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:33.641999 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:33.641962    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqb9n"
Jul 12 17:03:34.108860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:34.108825    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:34.671852 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:34.671806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:34.881183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:34.881151    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:35.081099 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.081012    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:35.180329 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.180296    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:35.285278 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.285244    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log" limit=1024
Jul 12 17:03:35.839697 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.839664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:35.842073 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.842039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40986600-cf46-4088-8f29-8089fc155080-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bl2rt\" (UID: \"40986600-cf46-4088-8f29-8089fc155080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:35.940476 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.940426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:35.940476 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.940482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.940509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940550    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.940556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940611    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940619    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:43.940598998 +0000 UTC m=+72.142432234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : configmap "kube-rbac-proxy" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940617    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940715    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls podName:ab429711-deb3-47be-8df4-3054a0680b29 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:51.940700764 +0000 UTC m=+80.142534015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lqx2b" (UID: "ab429711-deb3-47be-8df4-3054a0680b29") : secret "cluster-monitoring-operator-tls" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940733    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:51.940724539 +0000 UTC m=+80.142557788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : configmap references non-existent config key: service-ca.crt
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940751    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs podName:179a6916-ac30-4a38-8283-0dbbb8404fbd nodeName:}" failed. No retries permitted until 2026-07-12 17:03:51.940740415 +0000 UTC m=+80.142573655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs") pod "router-default-747fb75d5b-hc9gg" (UID: "179a6916-ac30-4a38-8283-0dbbb8404fbd") : secret "router-metrics-certs-default" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.940789    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940884    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:35.940950 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:35.940921    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls podName:9b9bb4a5-1579-4068-937d-d620c91fa0d9 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:43.940911278 +0000 UTC m=+72.142744512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zltng" (UID: "9b9bb4a5-1579-4068-937d-d620c91fa0d9") : secret "insights-runtime-extractor-tls" not found
Jul 12 17:03:35.949181 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.949162    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7g8v7\""
Jul 12 17:03:35.955732 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:35.955713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"
Jul 12 17:03:36.041311 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:36.041272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:36.041447 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:36.041415    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 17:03:36.041511 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:36.041475    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert podName:3cad6402-e9c7-42bb-9da0-153633513406 nodeName:}" failed. No retries permitted until 2026-07-12 17:03:52.041459128 +0000 UTC m=+80.243292386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9txd" (UID: "3cad6402-e9c7-42bb-9da0-153633513406") : secret "networking-console-plugin-cert" not found
Jul 12 17:03:36.084291 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:36.084248    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt"]
Jul 12 17:03:36.702252 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:36.702214    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:36.702746 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:36.702731    2584 scope.go:117] "RemoveContainer" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"
Jul 12 17:03:36.703002 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:36.702946    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pzm79_openshift-console-operator(3b88f1c8-6213-4002-95bc-6d813a8a9379)\"" pod="openshift-console-operator/console-operator-7866497494-pzm79" podUID="3b88f1c8-6213-4002-95bc-6d813a8a9379"
Jul 12 17:03:36.760497 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:36.760461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt" event={"ID":"40986600-cf46-4088-8f29-8089fc155080","Type":"ContainerStarted","Data":"110665401d89a1c98b89a6fdb000b7f4f53883d04ee9998fb44c47236d3aa368"}
Jul 12 17:03:37.766032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:37.765997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt" event={"ID":"40986600-cf46-4088-8f29-8089fc155080","Type":"ContainerStarted","Data":"63240f5472e9c471d04d159bc86f8316a752322f4303f9da32d7d14d2d7c9d15"}
Jul 12 17:03:37.766490 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:37.766079    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt" event={"ID":"40986600-cf46-4088-8f29-8089fc155080","Type":"ContainerStarted","Data":"6ff4a3121088b4b7fc5fc997bce595556e07d2efcd544b62ff37d1899c4cf933"}
Jul 12 17:03:37.784374 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:37.784271    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bl2rt" podStartSLOduration=17.379090377 podStartE2EDuration="18.784251029s" totalImagesPullingTime="1.405160652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:37.783659624 +0000 UTC m=+65.985492881" watchObservedRunningTime="2026-07-12 17:03:37.784251029 +0000 UTC m=+65.986084287"
Jul 12 17:03:38.162639 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.162599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:38.162860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.162720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:03:38.162860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.162793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:38.165362 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.165335    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgr9\" (UniqueName: \"kubernetes.io/projected/d794f6b0-ee38-42df-b981-207be62fc9f9-kube-api-access-jxgr9\") pod \"network-check-target-s75vp\" (UID: \"d794f6b0-ee38-42df-b981-207be62fc9f9\") " pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:38.165464 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.165401    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 17:03:38.165521 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.165504    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 17:03:38.172999 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:38.172976    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 17:03:38.173094 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:03:38.173051    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs podName:6284bb2f-3b84-4586-92d0-ce568d42cb91 nodeName:}" failed. No retries permitted until 2026-07-12 17:04:42.173027629 +0000 UTC m=+130.374860878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs") pod "network-metrics-daemon-9hphh" (UID: "6284bb2f-3b84-4586-92d0-ce568d42cb91") : secret "metrics-daemon-secret" not found
Jul 12 17:03:38.175065 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.175048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f022beb1-077c-4449-b0d8-ef5d9897c525-original-pull-secret\") pod \"global-pull-secret-syncer-x462c\" (UID: \"f022beb1-077c-4449-b0d8-ef5d9897c525\") " pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:38.339276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.339247    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgjd4\""
Jul 12 17:03:38.347552 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.347528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:38.347552 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.347549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x462c"
Jul 12 17:03:38.499086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.499048    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s75vp"]
Jul 12 17:03:38.503676 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:38.503632    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd794f6b0_ee38_42df_b981_207be62fc9f9.slice/crio-43bebd091e0a7e5a6d8a47071059280455b026bb32b75d44b7461cb5f826c640 WatchSource:0}: Error finding container 43bebd091e0a7e5a6d8a47071059280455b026bb32b75d44b7461cb5f826c640: Status 404 returned error can't find the container with id 43bebd091e0a7e5a6d8a47071059280455b026bb32b75d44b7461cb5f826c640
Jul 12 17:03:38.511483 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.511461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x462c"]
Jul 12 17:03:38.515954 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:38.515925    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf022beb1_077c_4449_b0d8_ef5d9897c525.slice/crio-c61f4d886e61911aea76e22cb6e5ba32b29acf658376864a7a67e1c0e61db6f1 WatchSource:0}: Error finding container c61f4d886e61911aea76e22cb6e5ba32b29acf658376864a7a67e1c0e61db6f1: Status 404 returned error can't find the container with id c61f4d886e61911aea76e22cb6e5ba32b29acf658376864a7a67e1c0e61db6f1
Jul 12 17:03:38.771219 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.771134    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x462c" event={"ID":"f022beb1-077c-4449-b0d8-ef5d9897c525","Type":"ContainerStarted","Data":"c61f4d886e61911aea76e22cb6e5ba32b29acf658376864a7a67e1c0e61db6f1"}
Jul 12 17:03:38.772622 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.772599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s75vp" event={"ID":"d794f6b0-ee38-42df-b981-207be62fc9f9","Type":"ContainerStarted","Data":"0992cda28fc626eaf1c4a59203183cc043650e495ce4057dc8ec97002678fdd3"}
Jul 12 17:03:38.772773 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.772639    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s75vp" event={"ID":"d794f6b0-ee38-42df-b981-207be62fc9f9","Type":"ContainerStarted","Data":"43bebd091e0a7e5a6d8a47071059280455b026bb32b75d44b7461cb5f826c640"}
Jul 12 17:03:38.772773 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.772687    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:03:38.789161 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:38.789113    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s75vp" podStartSLOduration=65.789094394 podStartE2EDuration="1m5.789094394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:38.788503752 +0000 UTC m=+66.990337009" watchObservedRunningTime="2026-07-12 17:03:38.789094394 +0000 UTC m=+66.990927652"
Jul 12 17:03:40.593344 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.593301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:40.593846 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.593378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:40.595957 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.595931    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6708a039-3106-4d72-a749-d8503371e856-metrics-tls\") pod \"dns-default-z4dk5\" (UID: \"6708a039-3106-4d72-a749-d8503371e856\") " pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:40.596254 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.596230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"image-registry-65bb47595-q77p7\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") " pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:40.769943 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.769908    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xrlpt\""
Jul 12 17:03:40.777341 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.777310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:40.789308 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.789143    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvzd7\""
Jul 12 17:03:40.796716 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.796678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:40.958903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.958865    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:03:40.962734 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:40.962633    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb439ff_23c8_469e_92b5_ff26f2c809fb.slice/crio-b2cec5d7b7e9ef0c612bddac660e5f38bcd05f8d41f2c8d879f02fa4ac5f360f WatchSource:0}: Error finding container b2cec5d7b7e9ef0c612bddac660e5f38bcd05f8d41f2c8d879f02fa4ac5f360f: Status 404 returned error can't find the container with id b2cec5d7b7e9ef0c612bddac660e5f38bcd05f8d41f2c8d879f02fa4ac5f360f
Jul 12 17:03:40.989781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:40.989729    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4dk5"]
Jul 12 17:03:40.992749 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:40.992717    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6708a039_3106_4d72_a749_d8503371e856.slice/crio-a47e971e572b28b709bdf9b7cb846b976e403b950d0bc61ee06cf4cfc6792d43 WatchSource:0}: Error finding container a47e971e572b28b709bdf9b7cb846b976e403b950d0bc61ee06cf4cfc6792d43: Status 404 returned error can't find the container with id a47e971e572b28b709bdf9b7cb846b976e403b950d0bc61ee06cf4cfc6792d43
Jul 12 17:03:41.789218 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:41.789173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65bb47595-q77p7" event={"ID":"ecb439ff-23c8-469e-92b5-ff26f2c809fb","Type":"ContainerStarted","Data":"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"}
Jul 12 17:03:41.789702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:41.789272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65bb47595-q77p7" event={"ID":"ecb439ff-23c8-469e-92b5-ff26f2c809fb","Type":"ContainerStarted","Data":"b2cec5d7b7e9ef0c612bddac660e5f38bcd05f8d41f2c8d879f02fa4ac5f360f"}
Jul 12 17:03:41.789702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:41.789300    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:03:41.790724 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:41.790664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4dk5" event={"ID":"6708a039-3106-4d72-a749-d8503371e856","Type":"ContainerStarted","Data":"a47e971e572b28b709bdf9b7cb846b976e403b950d0bc61ee06cf4cfc6792d43"}
Jul 12 17:03:41.809901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:41.809847    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65bb47595-q77p7" podStartSLOduration=68.809832315 podStartE2EDuration="1m8.809832315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:41.809301592 +0000 UTC m=+70.011134851" watchObservedRunningTime="2026-07-12 17:03:41.809832315 +0000 UTC m=+70.011665572"
Jul 12 17:03:43.799700 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:43.799652    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x462c" event={"ID":"f022beb1-077c-4449-b0d8-ef5d9897c525","Type":"ContainerStarted","Data":"6147d74aa1ae77854e0f6da439cab67a9ba1084418bd13f180fecf08d31e5565"}
Jul 12 17:03:43.817110 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:43.817046    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x462c" podStartSLOduration=66.511579297 podStartE2EDuration="1m10.817029084s" totalImagesPullingTime="4.305449787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:43.816492652 +0000 UTC m=+72.018325909" watchObservedRunningTime="2026-07-12 17:03:43.817029084 +0000 UTC m=+72.018862340"
Jul 12 17:03:44.028975 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.028933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:44.029159 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.029039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:44.029652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.029628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b9bb4a5-1579-4068-937d-d620c91fa0d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:44.031460 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.031436    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b9bb4a5-1579-4068-937d-d620c91fa0d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zltng\" (UID: \"9b9bb4a5-1579-4068-937d-d620c91fa0d9\") " pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:44.102472 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.102389    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vs9jl\""
Jul 12 17:03:44.109864 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.109835    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zltng"
Jul 12 17:03:44.312947 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.312914    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zltng"]
Jul 12 17:03:44.318118 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:44.318089    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9bb4a5_1579_4068_937d_d620c91fa0d9.slice/crio-71401146e17fc8d3e63f66cb575b96cad8beb2bb54453289425d973b24de38a7 WatchSource:0}: Error finding container 71401146e17fc8d3e63f66cb575b96cad8beb2bb54453289425d973b24de38a7: Status 404 returned error can't find the container with id 71401146e17fc8d3e63f66cb575b96cad8beb2bb54453289425d973b24de38a7
Jul 12 17:03:44.806099 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.805895    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4dk5" event={"ID":"6708a039-3106-4d72-a749-d8503371e856","Type":"ContainerStarted","Data":"136a3dd20dc0640c918b673da86e4922b8193dd9e5aad8ef3d227d212a981747"}
Jul 12 17:03:44.806099 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.805969    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4dk5" event={"ID":"6708a039-3106-4d72-a749-d8503371e856","Type":"ContainerStarted","Data":"582c1616c469b0be4e8ff34c7ab57154736a63ddd71b929bad3a0b2cf0e21310"}
Jul 12 17:03:44.806099 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.806010    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:44.807343 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.807316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zltng" event={"ID":"9b9bb4a5-1579-4068-937d-d620c91fa0d9","Type":"ContainerStarted","Data":"71401146e17fc8d3e63f66cb575b96cad8beb2bb54453289425d973b24de38a7"}
Jul 12 17:03:44.825126 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:44.825062    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z4dk5" podStartSLOduration=33.592185191 podStartE2EDuration="36.825044518s" totalImagesPullingTime="3.232859327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:44.82325308 +0000 UTC m=+73.025086339" watchObservedRunningTime="2026-07-12 17:03:44.825044518 +0000 UTC m=+73.026877752"
Jul 12 17:03:48.825654 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:48.825621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zltng" event={"ID":"9b9bb4a5-1579-4068-937d-d620c91fa0d9","Type":"ContainerStarted","Data":"5b7e8c23452675f1e46d9b2a7dbeaac54580b4929c3d16c561d373714d5d7e9f"}
Jul 12 17:03:48.826039 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:48.825677    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zltng" event={"ID":"9b9bb4a5-1579-4068-937d-d620c91fa0d9","Type":"ContainerStarted","Data":"c2614d7378fa3b0fd05d17107c943fb4305737b56df577b901298a2303d985b1"}
Jul 12 17:03:49.373958 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:49.373923    2584 scope.go:117] "RemoveContainer" containerID="558087c83695a1a901ba3240a13908c2430ea3a1debd18365f3f661aec0a5dc1"
Jul 12 17:03:49.832500 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:49.832418    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:03:49.832993 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:49.832516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pzm79" event={"ID":"3b88f1c8-6213-4002-95bc-6d813a8a9379","Type":"ContainerStarted","Data":"98d3736fc9fb1c193cebe034a5c44f0733111da8f1ed694f2ec2ce6d743b735a"}
Jul 12 17:03:49.832993 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:49.832804    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:49.964447 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:49.964412    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-pzm79"
Jul 12 17:03:51.168440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.168407    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-nzvx6"]
Jul 12 17:03:51.171410 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.171391    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:03:51.178349 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.178331    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 17:03:51.179336 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.179319    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 17:03:51.179419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.179325    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8qbgf\""
Jul 12 17:03:51.191162 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.191137    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nzvx6"]
Jul 12 17:03:51.197938 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.197907    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/e5eb002f-0c8a-484b-8d26-f73765e5747f-kube-api-access-dw7tb\") pod \"downloads-68c9cbb497-nzvx6\" (UID: \"e5eb002f-0c8a-484b-8d26-f73765e5747f\") " pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:03:51.298704 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.298663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/e5eb002f-0c8a-484b-8d26-f73765e5747f-kube-api-access-dw7tb\") pod \"downloads-68c9cbb497-nzvx6\" (UID: \"e5eb002f-0c8a-484b-8d26-f73765e5747f\") " pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:03:51.310704 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.310672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/e5eb002f-0c8a-484b-8d26-f73765e5747f-kube-api-access-dw7tb\") pod \"downloads-68c9cbb497-nzvx6\" (UID: \"e5eb002f-0c8a-484b-8d26-f73765e5747f\") " pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:03:51.480486 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.480396    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:03:51.614731 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.614672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-nzvx6"]
Jul 12 17:03:51.618928 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:51.618893    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5eb002f_0c8a_484b_8d26_f73765e5747f.slice/crio-77ea15398656e444184dc36f21c0a0cf11d1dbb1b9ed76a87218fe7bf7924aed WatchSource:0}: Error finding container 77ea15398656e444184dc36f21c0a0cf11d1dbb1b9ed76a87218fe7bf7924aed: Status 404 returned error can't find the container with id 77ea15398656e444184dc36f21c0a0cf11d1dbb1b9ed76a87218fe7bf7924aed
Jul 12 17:03:51.842057 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.841963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zltng" event={"ID":"9b9bb4a5-1579-4068-937d-d620c91fa0d9","Type":"ContainerStarted","Data":"55e23c52d4f8a94175e7d489f8bdc6cf28d3ec446819272d71446ea70bd2abc2"}
Jul 12 17:03:51.843036 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.843012    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nzvx6" event={"ID":"e5eb002f-0c8a-484b-8d26-f73765e5747f","Type":"ContainerStarted","Data":"77ea15398656e444184dc36f21c0a0cf11d1dbb1b9ed76a87218fe7bf7924aed"}
Jul 12 17:03:51.862178 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:51.862127    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zltng" podStartSLOduration=17.10312429 podStartE2EDuration="23.862110495s" totalImagesPullingTime="6.758986205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:03:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:51.861716034 +0000 UTC m=+80.063549296" watchObservedRunningTime="2026-07-12 17:03:51.862110495 +0000 UTC m=+80.063943753"
Jul 12 17:03:52.005155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.005118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:52.005155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.005158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:52.005414 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.005206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:52.005953 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.005930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/179a6916-ac30-4a38-8283-0dbbb8404fbd-service-ca-bundle\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:52.007931 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.007728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab429711-deb3-47be-8df4-3054a0680b29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lqx2b\" (UID: \"ab429711-deb3-47be-8df4-3054a0680b29\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:52.007931 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.007792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/179a6916-ac30-4a38-8283-0dbbb8404fbd-metrics-certs\") pod \"router-default-747fb75d5b-hc9gg\" (UID: \"179a6916-ac30-4a38-8283-0dbbb8404fbd\") " pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:52.105927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.105890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:52.108311 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.108290    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cad6402-e9c7-42bb-9da0-153633513406-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9txd\" (UID: \"3cad6402-e9c7-42bb-9da0-153633513406\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:52.193547 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.193512    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pcqmx\""
Jul 12 17:03:52.201742 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.201712    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"
Jul 12 17:03:52.223318 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.223287    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-md5zp\""
Jul 12 17:03:52.231599 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.231413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:52.307863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.307330    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-46v2b\""
Jul 12 17:03:52.315737 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.315706    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd"
Jul 12 17:03:52.397393 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.397358    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b"]
Jul 12 17:03:52.426913 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.426858    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-747fb75d5b-hc9gg"]
Jul 12 17:03:52.429650 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:52.429621    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179a6916_ac30_4a38_8283_0dbbb8404fbd.slice/crio-1c36e7747786555c82102b6dde1798c0b5ceaee6e3b129aa7c19ba6928472050 WatchSource:0}: Error finding container 1c36e7747786555c82102b6dde1798c0b5ceaee6e3b129aa7c19ba6928472050: Status 404 returned error can't find the container with id 1c36e7747786555c82102b6dde1798c0b5ceaee6e3b129aa7c19ba6928472050
Jul 12 17:03:52.500299 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.500275    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9txd"]
Jul 12 17:03:52.503673 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:52.503635    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cad6402_e9c7_42bb_9da0_153633513406.slice/crio-ac6a84673ee67914b87a2705491fe1fabf6c506d1540e0576c98f8ddd79ceb26 WatchSource:0}: Error finding container ac6a84673ee67914b87a2705491fe1fabf6c506d1540e0576c98f8ddd79ceb26: Status 404 returned error can't find the container with id ac6a84673ee67914b87a2705491fe1fabf6c506d1540e0576c98f8ddd79ceb26
Jul 12 17:03:52.848644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.848473    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b" event={"ID":"ab429711-deb3-47be-8df4-3054a0680b29","Type":"ContainerStarted","Data":"0970e01ce4140b16de15e3bb11108e80cb1f63cd8747329d747ccd91b28cde6e"}
Jul 12 17:03:52.850010 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.849973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd" event={"ID":"3cad6402-e9c7-42bb-9da0-153633513406","Type":"ContainerStarted","Data":"ac6a84673ee67914b87a2705491fe1fabf6c506d1540e0576c98f8ddd79ceb26"}
Jul 12 17:03:52.852063 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.851966    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-747fb75d5b-hc9gg" event={"ID":"179a6916-ac30-4a38-8283-0dbbb8404fbd","Type":"ContainerStarted","Data":"6dd94e426e6a77b78c2853aa18129faf39d7314b610c63af092695dec8ed678a"}
Jul 12 17:03:52.852063 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.852018    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-747fb75d5b-hc9gg" event={"ID":"179a6916-ac30-4a38-8283-0dbbb8404fbd","Type":"ContainerStarted","Data":"1c36e7747786555c82102b6dde1798c0b5ceaee6e3b129aa7c19ba6928472050"}
Jul 12 17:03:52.870432 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:52.870361    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-747fb75d5b-hc9gg" podStartSLOduration=33.870340892 podStartE2EDuration="33.870340892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:52.869356494 +0000 UTC m=+81.071189753" watchObservedRunningTime="2026-07-12 17:03:52.870340892 +0000 UTC m=+81.072174152"
Jul 12 17:03:53.232423 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:53.232355    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:53.236013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:53.235977    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:53.856810 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:53.856756    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:53.858740 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:53.858539    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-747fb75d5b-hc9gg"
Jul 12 17:03:54.813309 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:54.813284    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z4dk5"
Jul 12 17:03:55.429777 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.429736    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"]
Jul 12 17:03:55.457640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.457598    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"]
Jul 12 17:03:55.457838 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.457740    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:55.460536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.460513    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 12 17:03:55.460660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.460596    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gbpz4\""
Jul 12 17:03:55.538194 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.538156    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4002d79-9681-41b7-8a11-e3a6d3acd4b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bwnjt\" (UID: \"b4002d79-9681-41b7-8a11-e3a6d3acd4b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:55.638738 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.638704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4002d79-9681-41b7-8a11-e3a6d3acd4b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bwnjt\" (UID: \"b4002d79-9681-41b7-8a11-e3a6d3acd4b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:55.641689 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.641665    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4002d79-9681-41b7-8a11-e3a6d3acd4b7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bwnjt\" (UID: \"b4002d79-9681-41b7-8a11-e3a6d3acd4b7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:55.769523 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.769429    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:55.868530 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.868412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b" event={"ID":"ab429711-deb3-47be-8df4-3054a0680b29","Type":"ContainerStarted","Data":"1985b62f4955ee9bff6448fb7b47cda8fd6db2bb855d456bb9dee1e4ac53e0b4"}
Jul 12 17:03:55.870894 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.870867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd" event={"ID":"3cad6402-e9c7-42bb-9da0-153633513406","Type":"ContainerStarted","Data":"7368c9ab199e3ecfd2c8630279443814834d3782a213427d90836ed2b5389265"}
Jul 12 17:03:55.890453 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.887622    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lqx2b" podStartSLOduration=34.469754026 podStartE2EDuration="36.887602138s" totalImagesPullingTime="2.417848112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:55.885702566 +0000 UTC m=+84.087535823" watchObservedRunningTime="2026-07-12 17:03:55.887602138 +0000 UTC m=+84.089435398"
Jul 12 17:03:55.907606 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.907540    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9txd" podStartSLOduration=33.591463678 podStartE2EDuration="35.907516958s" totalImagesPullingTime="2.31605328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:55.906944713 +0000 UTC m=+84.108777970" watchObservedRunningTime="2026-07-12 17:03:55.907516958 +0000 UTC m=+84.109350216"
Jul 12 17:03:55.943438 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:55.943407    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"]
Jul 12 17:03:55.947291 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:03:55.947220    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4002d79_9681_41b7_8a11_e3a6d3acd4b7.slice/crio-9b8c6a932b00449c3c12aa650ffd93a0c4da8eae88bd93448a8ce2b0eca560d6 WatchSource:0}: Error finding container 9b8c6a932b00449c3c12aa650ffd93a0c4da8eae88bd93448a8ce2b0eca560d6: Status 404 returned error can't find the container with id 9b8c6a932b00449c3c12aa650ffd93a0c4da8eae88bd93448a8ce2b0eca560d6
Jul 12 17:03:56.876012 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:56.875971    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt" event={"ID":"b4002d79-9681-41b7-8a11-e3a6d3acd4b7","Type":"ContainerStarted","Data":"9b8c6a932b00449c3c12aa650ffd93a0c4da8eae88bd93448a8ce2b0eca560d6"}
Jul 12 17:03:57.883863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:57.883801    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt" event={"ID":"b4002d79-9681-41b7-8a11-e3a6d3acd4b7","Type":"ContainerStarted","Data":"022bf53432b473dee6c9a313616f75014033fa42074a243b1c8cef8a5eb764e2"}
Jul 12 17:03:57.884324 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:57.884051    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:57.889079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:57.889057    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt"
Jul 12 17:03:57.901584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:03:57.901540    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bwnjt" podStartSLOduration=1.335866297 podStartE2EDuration="2.901526526s" totalImagesPullingTime="1.565660229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:03:57.90012981 +0000 UTC m=+86.101963066" watchObservedRunningTime="2026-07-12 17:03:57.901526526 +0000 UTC m=+86.103359795"
Jul 12 17:04:00.783071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:00.783037    2584 patch_prober.go:28] interesting pod/image-registry-65bb47595-q77p7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 17:04:00.783519 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:00.783091    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65bb47595-q77p7" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 17:04:02.799508 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:02.799479    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:04:08.928114 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.928076    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gq5xc"]
Jul 12 17:04:08.954576 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.954547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:08.958651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.958075    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 17:04:08.958651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.958321    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 17:04:08.958651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.958522    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 17:04:08.958651 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.958533    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rbqq8\""
Jul 12 17:04:08.959192 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:08.959174    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 17:04:09.059203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-root\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-metrics-client-ca\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-textfile\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059295    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059392 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-wtmp\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059666 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059394    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872md\" (UniqueName: \"kubernetes.io/projected/359ad6b3-e60c-49be-819f-f561f1c66cdd-kube-api-access-872md\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.059666 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.059429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-sys\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.159920 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.159875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-root\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160107 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.159941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-metrics-client-ca\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160107 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.159970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160107 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.159980    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-root\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160107 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-textfile\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160107 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160057    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160113    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-wtmp\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-872md\" (UniqueName: \"kubernetes.io/projected/359ad6b3-e60c-49be-819f-f561f1c66cdd-kube-api-access-872md\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-sys\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-sys\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160616 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-textfile\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.160616 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:04:09.160600    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 12 17:04:09.160722 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:04:09.160667    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls podName:359ad6b3-e60c-49be-819f-f561f1c66cdd nodeName:}" failed. No retries permitted until 2026-07-12 17:04:09.660646729 +0000 UTC m=+97.862479979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls") pod "node-exporter-gq5xc" (UID: "359ad6b3-e60c-49be-819f-f561f1c66cdd") : secret "node-exporter-tls" not found
Jul 12 17:04:09.160722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.160697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-wtmp\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.161450 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.161409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-metrics-client-ca\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.161998 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.161975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.163380 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.163320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.175977 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.175946    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-872md\" (UniqueName: \"kubernetes.io/projected/359ad6b3-e60c-49be-819f-f561f1c66cdd-kube-api-access-872md\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.664851 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.664809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.667221 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.667196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/359ad6b3-e60c-49be-819f-f561f1c66cdd-node-exporter-tls\") pod \"node-exporter-gq5xc\" (UID: \"359ad6b3-e60c-49be-819f-f561f1c66cdd\") " pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.782531 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.782497    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s75vp"
Jul 12 17:04:09.867088 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.867046    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq5xc"
Jul 12 17:04:09.901965 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:04:09.901929    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359ad6b3_e60c_49be_819f_f561f1c66cdd.slice/crio-234aaceeb85f7f3dce99550a88b56bd67f87f096750c3e726325287e9cde3cad WatchSource:0}: Error finding container 234aaceeb85f7f3dce99550a88b56bd67f87f096750c3e726325287e9cde3cad: Status 404 returned error can't find the container with id 234aaceeb85f7f3dce99550a88b56bd67f87f096750c3e726325287e9cde3cad
Jul 12 17:04:09.938176 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.938040    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq5xc" event={"ID":"359ad6b3-e60c-49be-819f-f561f1c66cdd","Type":"ContainerStarted","Data":"234aaceeb85f7f3dce99550a88b56bd67f87f096750c3e726325287e9cde3cad"}
Jul 12 17:04:09.940131 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.940093    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-nzvx6" event={"ID":"e5eb002f-0c8a-484b-8d26-f73765e5747f","Type":"ContainerStarted","Data":"42c64d2d437297732c26ccef0cad3b9489c1c8e8c0ad54ef95e4575c90f4f6a1"}
Jul 12 17:04:09.940457 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.940427    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:04:09.960664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.960634    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-nzvx6"
Jul 12 17:04:09.970167 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:09.970108    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-nzvx6" podStartSLOduration=1.274634718 podStartE2EDuration="18.970088698s" totalImagesPullingTime="17.69545398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:04:09.969126621 +0000 UTC m=+98.170959878" watchObservedRunningTime="2026-07-12 17:04:09.970088698 +0000 UTC m=+98.171921959"
Jul 12 17:04:11.963931 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:11.963403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq5xc" event={"ID":"359ad6b3-e60c-49be-819f-f561f1c66cdd","Type":"ContainerStarted","Data":"4d1cb9df1ebeffdb6b6004021260f48d281a7e96055789912af01ad36e72a6ee"}
Jul 12 17:04:12.969319 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:12.969283    2584 generic.go:356] "Generic (PLEG): container finished" podID="359ad6b3-e60c-49be-819f-f561f1c66cdd" containerID="4d1cb9df1ebeffdb6b6004021260f48d281a7e96055789912af01ad36e72a6ee" exitCode=0
Jul 12 17:04:12.969788 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:12.969343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq5xc" event={"ID":"359ad6b3-e60c-49be-819f-f561f1c66cdd","Type":"ContainerDied","Data":"4d1cb9df1ebeffdb6b6004021260f48d281a7e96055789912af01ad36e72a6ee"}
Jul 12 17:04:13.977122 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:13.977083    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq5xc" event={"ID":"359ad6b3-e60c-49be-819f-f561f1c66cdd","Type":"ContainerStarted","Data":"c16631ad4dffda018abd863972a44751bdf96a40795d493ace3d44c58b6728fa"}
Jul 12 17:04:13.977669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:13.977151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq5xc" event={"ID":"359ad6b3-e60c-49be-819f-f561f1c66cdd","Type":"ContainerStarted","Data":"f318adb8ceaefcf48afdd820eb686e6929e2347181a8c7ab6b4fcaa8435ce016"}
Jul 12 17:04:14.000719 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:14.000646    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gq5xc" podStartSLOduration=4.081991833 podStartE2EDuration="6.000624341s" totalImagesPullingTime="1.806330656s" totalInitContainerRuntime="112.301852ms" isStatefulPod=true podCreationTimestamp="2026-07-12 17:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:04:13.997881241 +0000 UTC m=+102.199714498" watchObservedRunningTime="2026-07-12 17:04:14.000624341 +0000 UTC m=+102.202457599"
Jul 12 17:04:18.384853 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:18.384822    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:04:42.259304 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:42.259262    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:04:42.261573 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:42.261539    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284bb2f-3b84-4586-92d0-ce568d42cb91-metrics-certs\") pod \"network-metrics-daemon-9hphh\" (UID: \"6284bb2f-3b84-4586-92d0-ce568d42cb91\") " pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:04:42.547386 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:42.547300    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wpssr\""
Jul 12 17:04:42.553032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:42.553011    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hphh"
Jul 12 17:04:42.714436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:42.714412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hphh"]
Jul 12 17:04:42.717025 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:04:42.716998    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6284bb2f_3b84_4586_92d0_ce568d42cb91.slice/crio-c12ede725d03ffb5b61329e34600561ef301f6c4066252a5f1c4b52031fa7fc9 WatchSource:0}: Error finding container c12ede725d03ffb5b61329e34600561ef301f6c4066252a5f1c4b52031fa7fc9: Status 404 returned error can't find the container with id c12ede725d03ffb5b61329e34600561ef301f6c4066252a5f1c4b52031fa7fc9
Jul 12 17:04:43.088567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.088529    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hphh" event={"ID":"6284bb2f-3b84-4586-92d0-ce568d42cb91","Type":"ContainerStarted","Data":"c12ede725d03ffb5b61329e34600561ef301f6c4066252a5f1c4b52031fa7fc9"}
Jul 12 17:04:43.406844 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.406800    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65bb47595-q77p7" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerName="registry" containerID="cri-o://47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19" gracePeriod=30
Jul 12 17:04:43.915670 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.915643    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:04:43.974895 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.974860    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.974895 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.974898    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.974926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.974947    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5xrx\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975025    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975040    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975062    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975086    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets\") pod \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\" (UID: \"ecb439ff-23c8-469e-92b5-ff26f2c809fb\") "
Jul 12 17:04:43.975488 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975439    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:04:43.975990 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.975953    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:04:43.977653 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.977624    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx" (OuterVolumeSpecName: "kube-api-access-k5xrx") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "kube-api-access-k5xrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:43.977882 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.977856    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:43.977951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.977878    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:04:43.977992 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.977953    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:43.977992 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.977972    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:04:43.983402 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:43.983375    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ecb439ff-23c8-469e-92b5-ff26f2c809fb" (UID: "ecb439ff-23c8-469e-92b5-ff26f2c809fb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:44.076106 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076066    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-image-registry-private-configuration\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076106 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076100    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-trusted-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076106 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076109    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-bound-sa-token\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076106 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076117    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ecb439ff-23c8-469e-92b5-ff26f2c809fb-installation-pull-secrets\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076356 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076125    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ecb439ff-23c8-469e-92b5-ff26f2c809fb-ca-trust-extracted\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076356 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076133    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-certificates\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076356 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076141    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-registry-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.076356 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.076151    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5xrx\" (UniqueName: \"kubernetes.io/projected/ecb439ff-23c8-469e-92b5-ff26f2c809fb-kube-api-access-k5xrx\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:04:44.093307 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.093269    2584 generic.go:356] "Generic (PLEG): container finished" podID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerID="47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19" exitCode=0
Jul 12 17:04:44.093465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.093314    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65bb47595-q77p7"
Jul 12 17:04:44.093465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.093359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65bb47595-q77p7" event={"ID":"ecb439ff-23c8-469e-92b5-ff26f2c809fb","Type":"ContainerDied","Data":"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"}
Jul 12 17:04:44.093465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.093424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65bb47595-q77p7" event={"ID":"ecb439ff-23c8-469e-92b5-ff26f2c809fb","Type":"ContainerDied","Data":"b2cec5d7b7e9ef0c612bddac660e5f38bcd05f8d41f2c8d879f02fa4ac5f360f"}
Jul 12 17:04:44.093465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.093447    2584 scope.go:117] "RemoveContainer" containerID="47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"
Jul 12 17:04:44.114475 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.114449    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:04:44.118747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.118726    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65bb47595-q77p7"]
Jul 12 17:04:44.281018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.280990    2584 scope.go:117] "RemoveContainer" containerID="47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"
Jul 12 17:04:44.281429 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:04:44.281406    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19\": container with ID starting with 47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19 not found: ID does not exist" containerID="47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"
Jul 12 17:04:44.281485 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.281439    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19"} err="failed to get container status \"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19\": rpc error: code = NotFound desc = could not find container \"47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19\": container with ID starting with 47225e415bd6de113e010d08c1e618dec1b1986e41ab78f42f27155e8433ba19 not found: ID does not exist"
Jul 12 17:04:44.378316 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:44.378283    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" path="/var/lib/kubelet/pods/ecb439ff-23c8-469e-92b5-ff26f2c809fb/volumes"
Jul 12 17:04:45.098477 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:45.098437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hphh" event={"ID":"6284bb2f-3b84-4586-92d0-ce568d42cb91","Type":"ContainerStarted","Data":"6c68a61f7c00e98423598700dd9556dbc26d939ff095daba18c266983c3da300"}
Jul 12 17:04:45.098925 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:45.098504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hphh" event={"ID":"6284bb2f-3b84-4586-92d0-ce568d42cb91","Type":"ContainerStarted","Data":"e3f44c4ad072a6e03807db00fc11cc4b4b30f7798d4b4cef324bd4ddf15be82e"}
Jul 12 17:04:45.115652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:45.115600    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9hphh" podStartSLOduration=130.549828688 podStartE2EDuration="2m12.115583823s" totalImagesPullingTime="1.565755135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:04:45.113973637 +0000 UTC m=+133.315806895" watchObservedRunningTime="2026-07-12 17:04:45.115583823 +0000 UTC m=+133.317417080"
Jul 12 17:04:48.110604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:48.110566    2584 generic.go:356] "Generic (PLEG): container finished" podID="79beeb21-6958-476f-b8e0-738d0e543390" containerID="786c0a2aa0575ac4ad980f763a23938f5bf880aba18dc4d02b41f6f0a9fe3b4d" exitCode=0
Jul 12 17:04:48.111249 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:48.110610    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28" event={"ID":"79beeb21-6958-476f-b8e0-738d0e543390","Type":"ContainerDied","Data":"786c0a2aa0575ac4ad980f763a23938f5bf880aba18dc4d02b41f6f0a9fe3b4d"}
Jul 12 17:04:48.111249 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:48.111035    2584 scope.go:117] "RemoveContainer" containerID="786c0a2aa0575ac4ad980f763a23938f5bf880aba18dc4d02b41f6f0a9fe3b4d"
Jul 12 17:04:49.116702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:49.116669    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s8c28" event={"ID":"79beeb21-6958-476f-b8e0-738d0e543390","Type":"ContainerStarted","Data":"055f460293e75c2886b07b3b88e0976971737204b02954b78c956763913f9148"}
Jul 12 17:04:57.148208 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:57.148174    2584 generic.go:356] "Generic (PLEG): container finished" podID="4aea25b8-c139-4ac3-8a88-22ac9284b52e" containerID="5b56cb88d77c2a4172d5a181d9bc343b119e6a53b432508d7c16bcc3bce02e96" exitCode=0
Jul 12 17:04:57.148550 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:57.148240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd" event={"ID":"4aea25b8-c139-4ac3-8a88-22ac9284b52e","Type":"ContainerDied","Data":"5b56cb88d77c2a4172d5a181d9bc343b119e6a53b432508d7c16bcc3bce02e96"}
Jul 12 17:04:57.148593 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:57.148556    2584 scope.go:117] "RemoveContainer" containerID="5b56cb88d77c2a4172d5a181d9bc343b119e6a53b432508d7c16bcc3bce02e96"
Jul 12 17:04:58.153555 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:58.153511    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q7nxd" event={"ID":"4aea25b8-c139-4ac3-8a88-22ac9284b52e","Type":"ContainerStarted","Data":"0292ed8bd84d6269ebd195c521f00779a873123c15e84a5aa160639fb0713c83"}
Jul 12 17:04:58.154961 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:58.154940    2584 generic.go:356] "Generic (PLEG): container finished" podID="e046bc82-fccb-43ba-9460-b5ad8c40fd05" containerID="15852d2e099c82fbbd07b5933b0a97b9cac33c4859428fa122459f99211a9386" exitCode=0
Jul 12 17:04:58.155047 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:58.154973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn" event={"ID":"e046bc82-fccb-43ba-9460-b5ad8c40fd05","Type":"ContainerDied","Data":"15852d2e099c82fbbd07b5933b0a97b9cac33c4859428fa122459f99211a9386"}
Jul 12 17:04:58.155215 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:58.155203    2584 scope.go:117] "RemoveContainer" containerID="15852d2e099c82fbbd07b5933b0a97b9cac33c4859428fa122459f99211a9386"
Jul 12 17:04:59.161481 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:04:59.161450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tvgmn" event={"ID":"e046bc82-fccb-43ba-9460-b5ad8c40fd05","Type":"ContainerStarted","Data":"9323ec42dddf7c4f2fb8efaee21e569da0367723074a585f72d5cd0bc21a77ce"}
Jul 12 17:06:30.558374 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.558335    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"]
Jul 12 17:06:30.558957 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.558872    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerName="registry"
Jul 12 17:06:30.558957 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.558892    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerName="registry"
Jul 12 17:06:30.559088 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.558993    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb439ff-23c8-469e-92b5-ff26f2c809fb" containerName="registry"
Jul 12 17:06:30.562004 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.561984    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.566698 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.566678    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 17:06:30.566870 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.566851    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 17:06:30.567972 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.567954    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hnl6p\""
Jul 12 17:06:30.573029 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.573007    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"]
Jul 12 17:06:30.706630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.706592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.706630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.706633    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbzj\" (UniqueName: \"kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.706874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.706658    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.807590 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.807556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.807752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.807598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbzj\" (UniqueName: \"kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.807752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.807630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.807999 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.807980    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.808039 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.808018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.816373 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.816309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbzj\" (UniqueName: \"kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:30.871292 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:30.871241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:31.000339 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:31.000307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"]
Jul 12 17:06:31.003353 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:06:31.003326    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97af03ab_5086_4231_b6f3_52797c2f5674.slice/crio-c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc WatchSource:0}: Error finding container c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc: Status 404 returned error can't find the container with id c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc
Jul 12 17:06:31.504152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:31.504118    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk" event={"ID":"97af03ab-5086-4231-b6f3-52797c2f5674","Type":"ContainerStarted","Data":"c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc"}
Jul 12 17:06:38.534814 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:38.534755    2584 generic.go:356] "Generic (PLEG): container finished" podID="97af03ab-5086-4231-b6f3-52797c2f5674" containerID="203eee5917713491c869ebcb69262f67366268b38a5c82cdacbbf7119f8fdcf0" exitCode=0
Jul 12 17:06:38.535202 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:38.534837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk" event={"ID":"97af03ab-5086-4231-b6f3-52797c2f5674","Type":"ContainerDied","Data":"203eee5917713491c869ebcb69262f67366268b38a5c82cdacbbf7119f8fdcf0"}
Jul 12 17:06:41.549987 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:41.549951    2584 generic.go:356] "Generic (PLEG): container finished" podID="97af03ab-5086-4231-b6f3-52797c2f5674" containerID="e0d19b692cf506de1587918b51b2f0e04b24af948705dbdf5ae4b1786dd3573b" exitCode=0
Jul 12 17:06:41.550362 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:41.550017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk" event={"ID":"97af03ab-5086-4231-b6f3-52797c2f5674","Type":"ContainerDied","Data":"e0d19b692cf506de1587918b51b2f0e04b24af948705dbdf5ae4b1786dd3573b"}
Jul 12 17:06:50.589555 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:50.589515    2584 generic.go:356] "Generic (PLEG): container finished" podID="97af03ab-5086-4231-b6f3-52797c2f5674" containerID="976bbd1f4799bdfade74a02897b9c1fef8e595d04531836049fd47cafb527f9a" exitCode=0
Jul 12 17:06:50.590090 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:50.589562    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk" event={"ID":"97af03ab-5086-4231-b6f3-52797c2f5674","Type":"ContainerDied","Data":"976bbd1f4799bdfade74a02897b9c1fef8e595d04531836049fd47cafb527f9a"}
Jul 12 17:06:51.720210 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.720185    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:51.790456 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.790424    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbzj\" (UniqueName: \"kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj\") pod \"97af03ab-5086-4231-b6f3-52797c2f5674\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") "
Jul 12 17:06:51.790456 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.790465    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle\") pod \"97af03ab-5086-4231-b6f3-52797c2f5674\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") "
Jul 12 17:06:51.790708 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.790509    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util\") pod \"97af03ab-5086-4231-b6f3-52797c2f5674\" (UID: \"97af03ab-5086-4231-b6f3-52797c2f5674\") "
Jul 12 17:06:51.791247 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.791223    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle" (OuterVolumeSpecName: "bundle") pod "97af03ab-5086-4231-b6f3-52797c2f5674" (UID: "97af03ab-5086-4231-b6f3-52797c2f5674"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:06:51.792914 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.792891    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj" (OuterVolumeSpecName: "kube-api-access-kpbzj") pod "97af03ab-5086-4231-b6f3-52797c2f5674" (UID: "97af03ab-5086-4231-b6f3-52797c2f5674"). InnerVolumeSpecName "kube-api-access-kpbzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:06:51.794987 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.794965    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util" (OuterVolumeSpecName: "util") pod "97af03ab-5086-4231-b6f3-52797c2f5674" (UID: "97af03ab-5086-4231-b6f3-52797c2f5674"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:06:51.892085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.892050    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbzj\" (UniqueName: \"kubernetes.io/projected/97af03ab-5086-4231-b6f3-52797c2f5674-kube-api-access-kpbzj\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:06:51.892085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.892084    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:06:51.892281 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:51.892093    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97af03ab-5086-4231-b6f3-52797c2f5674-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:06:52.599233 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:52.599198    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk"
Jul 12 17:06:52.599407 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:52.599197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s5rhk" event={"ID":"97af03ab-5086-4231-b6f3-52797c2f5674","Type":"ContainerDied","Data":"c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc"}
Jul 12 17:06:52.599407 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:06:52.599323    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c262756b118fff7d89dd10de7bc90dbde08741bcba00fcb0acbe7ba1307309fc"
Jul 12 17:07:02.753409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753322    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"]
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753653    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="extract"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753666    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="extract"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753680    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="util"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753685    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="util"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753697    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="pull"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753703    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="pull"
Jul 12 17:07:02.753863 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.753796    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="97af03ab-5086-4231-b6f3-52797c2f5674" containerName="extract"
Jul 12 17:07:02.756755 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.756738    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.760849 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.760828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hnl6p\""
Jul 12 17:07:02.761281 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.761265    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 17:07:02.762065 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.762044    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 17:07:02.768412 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.768385    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"]
Jul 12 17:07:02.874407 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.874366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.874407 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.874409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.874622 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.874493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plsdn\" (UniqueName: \"kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.975216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.975177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.975216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.975218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.975390 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.975290    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plsdn\" (UniqueName: \"kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.975638 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.975618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.975674 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.975633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:02.984169 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:02.984134    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsdn\" (UniqueName: \"kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:03.066121 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:03.066021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:03.200754 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:03.200713    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"]
Jul 12 17:07:03.203870 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:03.203844    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15f7f9a_91be_4850_bd77_a028876b15ee.slice/crio-a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54 WatchSource:0}: Error finding container a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54: Status 404 returned error can't find the container with id a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54
Jul 12 17:07:03.639154 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:03.639120    2584 generic.go:356] "Generic (PLEG): container finished" podID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerID="69234dc05d4475f19b6edbae98f1ecf6aba232965576f876b5e7f132f4bbd11f" exitCode=0
Jul 12 17:07:03.639340 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:03.639204    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb" event={"ID":"b15f7f9a-91be-4850-bd77-a028876b15ee","Type":"ContainerDied","Data":"69234dc05d4475f19b6edbae98f1ecf6aba232965576f876b5e7f132f4bbd11f"}
Jul 12 17:07:03.639340 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:03.639257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb" event={"ID":"b15f7f9a-91be-4850-bd77-a028876b15ee","Type":"ContainerStarted","Data":"a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54"}
Jul 12 17:07:06.651400 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.651366    2584 generic.go:356] "Generic (PLEG): container finished" podID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerID="145b220de44926a62d4e855761b98c030cc07afcd196a3755a0744bd3db35242" exitCode=0
Jul 12 17:07:06.651806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.651414    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb" event={"ID":"b15f7f9a-91be-4850-bd77-a028876b15ee","Type":"ContainerDied","Data":"145b220de44926a62d4e855761b98c030cc07afcd196a3755a0744bd3db35242"}
Jul 12 17:07:06.905431 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.905346    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"]
Jul 12 17:07:06.908441 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.908426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:06.910972 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.910950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 17:07:06.911102 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.911056    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 17:07:06.911157 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.911057    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mtbms\""
Jul 12 17:07:06.915075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:06.914973    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"]
Jul 12 17:07:07.006035 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.006001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.006214 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.006059    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtfw\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-kube-api-access-cwtfw\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.106851 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.106808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.111818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.106887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtfw\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-kube-api-access-cwtfw\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.115537 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.115506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.115669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.115650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtfw\" (UniqueName: \"kubernetes.io/projected/4c76907a-a2d7-4206-8775-19b722d26eff-kube-api-access-cwtfw\") pod \"cert-manager-cainjector-559cdd8c87-q4ktr\" (UID: \"4c76907a-a2d7-4206-8775-19b722d26eff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.231937 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.231842    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"
Jul 12 17:07:07.359103 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.359078    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr"]
Jul 12 17:07:07.361498 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:07.361467    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c76907a_a2d7_4206_8775_19b722d26eff.slice/crio-0b4daa4692bcfb5d3e2274306354c7b5266871174f250ca6d02a82a7e9a7c35c WatchSource:0}: Error finding container 0b4daa4692bcfb5d3e2274306354c7b5266871174f250ca6d02a82a7e9a7c35c: Status 404 returned error can't find the container with id 0b4daa4692bcfb5d3e2274306354c7b5266871174f250ca6d02a82a7e9a7c35c
Jul 12 17:07:07.656302 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.656260    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr" event={"ID":"4c76907a-a2d7-4206-8775-19b722d26eff","Type":"ContainerStarted","Data":"0b4daa4692bcfb5d3e2274306354c7b5266871174f250ca6d02a82a7e9a7c35c"}
Jul 12 17:07:07.658276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.658245    2584 generic.go:356] "Generic (PLEG): container finished" podID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerID="df7b89845f2ebd3c25f7819720bbc5ab54af5c7ae1d4f4bf3a6c26056374ff39" exitCode=0
Jul 12 17:07:07.658420 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:07.658299    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb" event={"ID":"b15f7f9a-91be-4850-bd77-a028876b15ee","Type":"ContainerDied","Data":"df7b89845f2ebd3c25f7819720bbc5ab54af5c7ae1d4f4bf3a6c26056374ff39"}
Jul 12 17:07:08.807484 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.807454    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:08.921781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.921678    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plsdn\" (UniqueName: \"kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn\") pod \"b15f7f9a-91be-4850-bd77-a028876b15ee\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") "
Jul 12 17:07:08.921945 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.921805    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle\") pod \"b15f7f9a-91be-4850-bd77-a028876b15ee\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") "
Jul 12 17:07:08.921945 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.921850    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util\") pod \"b15f7f9a-91be-4850-bd77-a028876b15ee\" (UID: \"b15f7f9a-91be-4850-bd77-a028876b15ee\") "
Jul 12 17:07:08.922342 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.922313    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle" (OuterVolumeSpecName: "bundle") pod "b15f7f9a-91be-4850-bd77-a028876b15ee" (UID: "b15f7f9a-91be-4850-bd77-a028876b15ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:07:08.924113 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.924088    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn" (OuterVolumeSpecName: "kube-api-access-plsdn") pod "b15f7f9a-91be-4850-bd77-a028876b15ee" (UID: "b15f7f9a-91be-4850-bd77-a028876b15ee"). InnerVolumeSpecName "kube-api-access-plsdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:07:08.927873 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:08.927833    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util" (OuterVolumeSpecName: "util") pod "b15f7f9a-91be-4850-bd77-a028876b15ee" (UID: "b15f7f9a-91be-4850-bd77-a028876b15ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:07:09.022916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.022878    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plsdn\" (UniqueName: \"kubernetes.io/projected/b15f7f9a-91be-4850-bd77-a028876b15ee-kube-api-access-plsdn\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:09.022916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.022914    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:09.022916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.022925    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b15f7f9a-91be-4850-bd77-a028876b15ee-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:09.670335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.670303    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb"
Jul 12 17:07:09.670335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.670314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft6vwb" event={"ID":"b15f7f9a-91be-4850-bd77-a028876b15ee","Type":"ContainerDied","Data":"a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54"}
Jul 12 17:07:09.670567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:09.670363    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0ef372bed4d99279b582cf61ee692c0cf47acfc6daab6d638082a58f3bedd54"
Jul 12 17:07:10.678115 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:10.678081    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr" event={"ID":"4c76907a-a2d7-4206-8775-19b722d26eff","Type":"ContainerStarted","Data":"396c94f208349e479d7b94c8c6ebf396fe79958169739c903477aa18dee8b083"}
Jul 12 17:07:10.704492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:10.704438    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q4ktr" podStartSLOduration=1.855298834 podStartE2EDuration="4.704422587s" totalImagesPullingTime="2.849123753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:07:10.703053417 +0000 UTC m=+278.904886688" watchObservedRunningTime="2026-07-12 17:07:10.704422587 +0000 UTC m=+278.906255844"
Jul 12 17:07:13.201373 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201335    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zdrfr"]
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201784    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="extract"
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201803    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="extract"
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201816    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="pull"
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201824    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="pull"
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201844    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="util"
Jul 12 17:07:13.201867 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201852    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="util"
Jul 12 17:07:13.202156 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.201943    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15f7f9a-91be-4850-bd77-a028876b15ee" containerName="extract"
Jul 12 17:07:13.205013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.204994    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.207424 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.207404    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f2zwc\""
Jul 12 17:07:13.214794 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.214771    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zdrfr"]
Jul 12 17:07:13.255635 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.255597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-bound-sa-token\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.255815 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.255660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzqn\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-kube-api-access-qjzqn\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.356319 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.356282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzqn\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-kube-api-access-qjzqn\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.356472 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.356336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-bound-sa-token\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.364565 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.364533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-bound-sa-token\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.364683 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.364610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzqn\" (UniqueName: \"kubernetes.io/projected/b56ce35a-11a7-4e3e-afd0-28d39c5f0e12-kube-api-access-qjzqn\") pod \"cert-manager-55b4d954d5-zdrfr\" (UID: \"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12\") " pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.514922 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.514817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zdrfr"
Jul 12 17:07:13.639312 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.639285    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zdrfr"]
Jul 12 17:07:13.641704 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:13.641669    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb56ce35a_11a7_4e3e_afd0_28d39c5f0e12.slice/crio-3d0bd14b17a5cc204436ba62f56b19330dfe0bb7458cdf9e573a1e5ba817fe0b WatchSource:0}: Error finding container 3d0bd14b17a5cc204436ba62f56b19330dfe0bb7458cdf9e573a1e5ba817fe0b: Status 404 returned error can't find the container with id 3d0bd14b17a5cc204436ba62f56b19330dfe0bb7458cdf9e573a1e5ba817fe0b
Jul 12 17:07:13.691130 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:13.691102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zdrfr" event={"ID":"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12","Type":"ContainerStarted","Data":"3d0bd14b17a5cc204436ba62f56b19330dfe0bb7458cdf9e573a1e5ba817fe0b"}
Jul 12 17:07:14.696556 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:14.696516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zdrfr" event={"ID":"b56ce35a-11a7-4e3e-afd0-28d39c5f0e12","Type":"ContainerStarted","Data":"6d4daff6243f80af8b05a4bfa26370c782e6c87e2d1323c71fdecf374212500c"}
Jul 12 17:07:14.713139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:14.713093    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zdrfr" podStartSLOduration=1.713074878 podStartE2EDuration="1.713074878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:07:14.711481393 +0000 UTC m=+282.913314650" watchObservedRunningTime="2026-07-12 17:07:14.713074878 +0000 UTC m=+282.914908135"
Jul 12 17:07:21.456967 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.456928    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"]
Jul 12 17:07:21.460679 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.460661    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.463339 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.463318    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 17:07:21.464404 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.464388    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 17:07:21.464484 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.464471    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hnl6p\""
Jul 12 17:07:21.467585 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.467564    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"]
Jul 12 17:07:21.522756 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.522719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.522944 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.522787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.522944 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.522843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7d2\" (UniqueName: \"kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.623832 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.623800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.623832 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.623834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.624016 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.623883    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7d2\" (UniqueName: \"kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.624178 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.624158    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.624257 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.624239    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.632423 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.632388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7d2\" (UniqueName: \"kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.771332 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.771241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:21.917064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:21.917030    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"]
Jul 12 17:07:21.920647 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:21.920622    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75981f23_4d90_4b5e_9f2d_4d4d0cfc4844.slice/crio-c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f WatchSource:0}: Error finding container c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f: Status 404 returned error can't find the container with id c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f
Jul 12 17:07:22.728819 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:22.728781    2584 generic.go:356] "Generic (PLEG): container finished" podID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerID="0778b517daa02ea8c459bfc34195392a2dbd7dd0117bb98b7a24d2e084b72cba" exitCode=0
Jul 12 17:07:22.729155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:22.728827    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2" event={"ID":"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844","Type":"ContainerDied","Data":"0778b517daa02ea8c459bfc34195392a2dbd7dd0117bb98b7a24d2e084b72cba"}
Jul 12 17:07:22.729155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:22.728890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2" event={"ID":"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844","Type":"ContainerStarted","Data":"c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f"}
Jul 12 17:07:23.734571 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:23.734521    2584 generic.go:356] "Generic (PLEG): container finished" podID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerID="1c9a5490d54b0489546a6a6be8772d0a90038c665f3b1e4056ddec8c00453ddd" exitCode=0
Jul 12 17:07:23.735005 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:23.734617    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2" event={"ID":"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844","Type":"ContainerDied","Data":"1c9a5490d54b0489546a6a6be8772d0a90038c665f3b1e4056ddec8c00453ddd"}
Jul 12 17:07:24.741409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:24.741374    2584 generic.go:356] "Generic (PLEG): container finished" podID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerID="431aaf8f2ae51526a73103f5c8c9cada09e12f6fec639d3c7f9d2d7fc895d49c" exitCode=0
Jul 12 17:07:24.741836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:24.741416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2" event={"ID":"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844","Type":"ContainerDied","Data":"431aaf8f2ae51526a73103f5c8c9cada09e12f6fec639d3c7f9d2d7fc895d49c"}
Jul 12 17:07:25.871484 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.871461    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:25.959237 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.959199    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle\") pod \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") "
Jul 12 17:07:25.959237 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.959239    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s7d2\" (UniqueName: \"kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2\") pod \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") "
Jul 12 17:07:25.959432 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.959262    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util\") pod \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\" (UID: \"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844\") "
Jul 12 17:07:25.959934 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.959909    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle" (OuterVolumeSpecName: "bundle") pod "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" (UID: "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:07:25.961309 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.961282    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2" (OuterVolumeSpecName: "kube-api-access-5s7d2") pod "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" (UID: "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844"). InnerVolumeSpecName "kube-api-access-5s7d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:07:25.965103 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:25.965084    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util" (OuterVolumeSpecName: "util") pod "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" (UID: "75981f23-4d90-4b5e-9f2d-4d4d0cfc4844"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:07:26.059902 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.059799    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:26.059902 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.059842    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s7d2\" (UniqueName: \"kubernetes.io/projected/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-kube-api-access-5s7d2\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:26.059902 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.059852    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75981f23-4d90-4b5e-9f2d-4d4d0cfc4844-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:07:26.751630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.751552    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2"
Jul 12 17:07:26.751790 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.751554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd7nv2" event={"ID":"75981f23-4d90-4b5e-9f2d-4d4d0cfc4844","Type":"ContainerDied","Data":"c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f"}
Jul 12 17:07:26.751790 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:26.751662    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8ccd924f614aae3f3acc9184cd60d245b9f28f079393980260d605a166e3c8f"
Jul 12 17:07:32.310071 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:32.310038    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:07:32.317272 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:32.317245    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:07:32.323243 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:32.323222    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 17:07:34.329246 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329199    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6459574568-klwtj"]
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329661    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="util"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329678    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="util"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329689    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="pull"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329695    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="pull"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329711    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="extract"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329717    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="extract"
Jul 12 17:07:34.331636 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.329788    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75981f23-4d90-4b5e-9f2d-4d4d0cfc4844" containerName="extract"
Jul 12 17:07:34.332595 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.332579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.335387 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.335362    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 17:07:34.335503 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.335419    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 17:07:34.336799 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.336780    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jjvqt\""
Jul 12 17:07:34.336899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.336826    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 17:07:34.336899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.336843    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 17:07:34.336899 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.336889    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 17:07:34.340716 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.340696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6459574568-klwtj"]
Jul 12 17:07:34.432276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.432241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lssgs\" (UniqueName: \"kubernetes.io/projected/c429177e-9f6f-4db2-8ef7-b50463fbae8e-kube-api-access-lssgs\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.432543 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.432294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.432543 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.432371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c429177e-9f6f-4db2-8ef7-b50463fbae8e-manager-config\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.432543 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.432403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-metrics-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.533556 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.533515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-metrics-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.533795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.533645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lssgs\" (UniqueName: \"kubernetes.io/projected/c429177e-9f6f-4db2-8ef7-b50463fbae8e-kube-api-access-lssgs\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.533795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.533685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.533795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.533747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c429177e-9f6f-4db2-8ef7-b50463fbae8e-manager-config\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.534363 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.534340    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c429177e-9f6f-4db2-8ef7-b50463fbae8e-manager-config\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.536084 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.536061    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.536214 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.536158    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c429177e-9f6f-4db2-8ef7-b50463fbae8e-metrics-cert\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.544216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.544188    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lssgs\" (UniqueName: \"kubernetes.io/projected/c429177e-9f6f-4db2-8ef7-b50463fbae8e-kube-api-access-lssgs\") pod \"lws-controller-manager-6459574568-klwtj\" (UID: \"c429177e-9f6f-4db2-8ef7-b50463fbae8e\") " pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.642567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.642514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:34.775361 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.775336    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6459574568-klwtj"]
Jul 12 17:07:34.777829 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:34.777804    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc429177e_9f6f_4db2_8ef7_b50463fbae8e.slice/crio-126e7d4143e489975cd6b84813b8287a8838df0a69957bead6b7b7115bfdfc27 WatchSource:0}: Error finding container 126e7d4143e489975cd6b84813b8287a8838df0a69957bead6b7b7115bfdfc27: Status 404 returned error can't find the container with id 126e7d4143e489975cd6b84813b8287a8838df0a69957bead6b7b7115bfdfc27
Jul 12 17:07:34.779709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.779695    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 17:07:34.789831 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:34.789792    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj" event={"ID":"c429177e-9f6f-4db2-8ef7-b50463fbae8e","Type":"ContainerStarted","Data":"126e7d4143e489975cd6b84813b8287a8838df0a69957bead6b7b7115bfdfc27"}
Jul 12 17:07:36.801596 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:36.801500    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj" event={"ID":"c429177e-9f6f-4db2-8ef7-b50463fbae8e","Type":"ContainerStarted","Data":"f3c43519c2d72a75e343cd52efae2519279e07277fddcc93aeabd84fb895dcdf"}
Jul 12 17:07:36.802075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:36.801630    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:36.824358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:36.824302    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj" podStartSLOduration=1.150499674 podStartE2EDuration="2.824286675s" totalImagesPullingTime="1.673787001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:07:36.823185318 +0000 UTC m=+305.025018575" watchObservedRunningTime="2026-07-12 17:07:36.824286675 +0000 UTC m=+305.026119931"
Jul 12 17:07:38.628093 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.628058    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"]
Jul 12 17:07:38.631451 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.631420    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.634507 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.634485    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6fnfz\""
Jul 12 17:07:38.634626 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.634530    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 17:07:38.634806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.634791    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 17:07:38.634926 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.634879    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 17:07:38.635055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.635042    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 17:07:38.651318 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.651286    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"]
Jul 12 17:07:38.772493 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.772457    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-manifests\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.772671 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.772501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.772671 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.772569    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.772671 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.772607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-tmp\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.772671 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.772651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fk2l\" (UniqueName: \"kubernetes.io/projected/4ea339eb-edbe-42c9-8d90-49670c97cfc3-kube-api-access-2fk2l\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.873948 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.873906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fk2l\" (UniqueName: \"kubernetes.io/projected/4ea339eb-edbe-42c9-8d90-49670c97cfc3-kube-api-access-2fk2l\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.873948 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.873953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-manifests\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.874212 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.873977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.874212 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.874012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.874212 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.874042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-tmp\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.874415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.874384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-manifests\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.876220 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.876199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ea339eb-edbe-42c9-8d90-49670c97cfc3-tmp\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.876510 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.876490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.876602 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.876581    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ea339eb-edbe-42c9-8d90-49670c97cfc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.882553 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.882498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fk2l\" (UniqueName: \"kubernetes.io/projected/4ea339eb-edbe-42c9-8d90-49670c97cfc3-kube-api-access-2fk2l\") pod \"opendatahub-operator-controller-manager-554bd9d4cc-6vdv8\" (UID: \"4ea339eb-edbe-42c9-8d90-49670c97cfc3\") " pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:38.942577 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:38.942539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:39.084901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:39.084875    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"]
Jul 12 17:07:39.086590 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:07:39.086564    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea339eb_edbe_42c9_8d90_49670c97cfc3.slice/crio-c1010a71faaba2c4180c763ed1b7ac00c47401c9cf18fd934fe99a36aafbfc1e WatchSource:0}: Error finding container c1010a71faaba2c4180c763ed1b7ac00c47401c9cf18fd934fe99a36aafbfc1e: Status 404 returned error can't find the container with id c1010a71faaba2c4180c763ed1b7ac00c47401c9cf18fd934fe99a36aafbfc1e
Jul 12 17:07:39.817003 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:39.816959    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8" event={"ID":"4ea339eb-edbe-42c9-8d90-49670c97cfc3","Type":"ContainerStarted","Data":"c1010a71faaba2c4180c763ed1b7ac00c47401c9cf18fd934fe99a36aafbfc1e"}
Jul 12 17:07:42.834335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:42.834294    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8" event={"ID":"4ea339eb-edbe-42c9-8d90-49670c97cfc3","Type":"ContainerStarted","Data":"3a832275ebe784d0d709692b53c50ac4074194a6caf3ccab11f4b09ef33db358"}
Jul 12 17:07:43.839576 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:43.839532    2584 generic.go:356] "Generic (PLEG): container finished" podID="4ea339eb-edbe-42c9-8d90-49670c97cfc3" containerID="3a832275ebe784d0d709692b53c50ac4074194a6caf3ccab11f4b09ef33db358" exitCode=0
Jul 12 17:07:43.839977 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:43.839597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8" event={"ID":"4ea339eb-edbe-42c9-8d90-49670c97cfc3","Type":"ContainerDied","Data":"3a832275ebe784d0d709692b53c50ac4074194a6caf3ccab11f4b09ef33db358"}
Jul 12 17:07:44.846223 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:44.846189    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8" event={"ID":"4ea339eb-edbe-42c9-8d90-49670c97cfc3","Type":"ContainerStarted","Data":"a7b005d5009f7244f523d49ef9efad8daa36b63f1d07bec0bb578fee0e9c6280"}
Jul 12 17:07:44.846749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:44.846302    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:07:44.870169 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:44.870115    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8" podStartSLOduration=2.417772215 podStartE2EDuration="6.870095211s" totalImagesPullingTime="3.355600071s" totalInitContainerRuntime="1.096722925s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:07:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:07:44.86786891 +0000 UTC m=+313.069702168" watchObservedRunningTime="2026-07-12 17:07:44.870095211 +0000 UTC m=+313.071928467"
Jul 12 17:07:47.807942 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:47.807909    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6459574568-klwtj"
Jul 12 17:07:55.853193 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:07:55.853158    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-554bd9d4cc-6vdv8"
Jul 12 17:08:06.019927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.019886    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"]
Jul 12 17:08:06.024123 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.024099    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.030246 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.030220    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 17:08:06.030536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.030516    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9nspz\""
Jul 12 17:08:06.050575 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.050542    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"]
Jul 12 17:08:06.078260 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078279    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36eedca2-b34e-43c5-baf4-28152589c9b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078454    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.078609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.078496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmm97\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-kube-api-access-bmm97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179375 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36eedca2-b34e-43c5-baf4-28152589c9b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmm97\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-kube-api-access-bmm97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179896 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179896 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.179896 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.180033 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.180033 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.179970    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.180140 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.180060    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.180198 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.180169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36eedca2-b34e-43c5-baf4-28152589c9b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.182157 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.182129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.182279 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.182214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.191324 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.191294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmm97\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-kube-api-access-bmm97\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.192462 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.192431    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36eedca2-b34e-43c5-baf4-28152589c9b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bnvlz\" (UID: \"36eedca2-b34e-43c5-baf4-28152589c9b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.335020 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.334923    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:06.505951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.505919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"]
Jul 12 17:08:06.509237 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:08:06.509211    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36eedca2_b34e_43c5_baf4_28152589c9b4.slice/crio-75610cea17201e781fa0f14b44c749b60ad0e7d49f0e258a4bc8e8c6d8e91a16 WatchSource:0}: Error finding container 75610cea17201e781fa0f14b44c749b60ad0e7d49f0e258a4bc8e8c6d8e91a16: Status 404 returned error can't find the container with id 75610cea17201e781fa0f14b44c749b60ad0e7d49f0e258a4bc8e8c6d8e91a16
Jul 12 17:08:06.953091 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:06.953054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz" event={"ID":"36eedca2-b34e-43c5-baf4-28152589c9b4","Type":"ContainerStarted","Data":"75610cea17201e781fa0f14b44c749b60ad0e7d49f0e258a4bc8e8c6d8e91a16"}
Jul 12 17:08:08.347032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.346996    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"]
Jul 12 17:08:08.354138 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.354108    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.357113 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.357087    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 17:08:08.357238 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.357222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 17:08:08.357308 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.357275    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 17:08:08.357366 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.357329    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h97ml\""
Jul 12 17:08:08.365473 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.365450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"]
Jul 12 17:08:08.398484 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/557ea33c-ab20-431e-b97a-1287c5c86ff3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398654 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398654 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwq8d\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-kube-api-access-hwq8d\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398654 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398654 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398913 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398653    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.398913 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.398716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.499903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.499864    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/557ea33c-ab20-431e-b97a-1287c5c86ff3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.499914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.499944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwq8d\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-kube-api-access-hwq8d\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.499978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.499999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.500202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.500258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.500801 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.500739    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.502742 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.502712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/557ea33c-ab20-431e-b97a-1287c5c86ff3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.502924 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.502899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.503029 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.502991    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.503076 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.503052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.510052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.510002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.510052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.510025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwq8d\" (UniqueName: \"kubernetes.io/projected/557ea33c-ab20-431e-b97a-1287c5c86ff3-kube-api-access-hwq8d\") pod \"istiod-openshift-gateway-94bb8fbfd-lkfb2\" (UID: \"557ea33c-ab20-431e-b97a-1287c5c86ff3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:08.665713 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:08.665674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:09.029908 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.029870    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:08:09.030031 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.029951    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:08:09.030381 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.030351    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:08:09.138436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.138401    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"]
Jul 12 17:08:09.142509 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:08:09.142466    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557ea33c_ab20_431e_b97a_1287c5c86ff3.slice/crio-3f7eab7102403a36c58893a8ef47ff185ed9df1a17d136e7d1f6f7e8d9dae3a6 WatchSource:0}: Error finding container 3f7eab7102403a36c58893a8ef47ff185ed9df1a17d136e7d1f6f7e8d9dae3a6: Status 404 returned error can't find the container with id 3f7eab7102403a36c58893a8ef47ff185ed9df1a17d136e7d1f6f7e8d9dae3a6
Jul 12 17:08:09.971100 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.971056    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz" event={"ID":"36eedca2-b34e-43c5-baf4-28152589c9b4","Type":"ContainerStarted","Data":"8e3e89351b983f3304a5a1e7c8aca6628c12cabea577f3e2ca0a047f3bfb371a"}
Jul 12 17:08:09.972608 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:09.972580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2" event={"ID":"557ea33c-ab20-431e-b97a-1287c5c86ff3","Type":"ContainerStarted","Data":"3f7eab7102403a36c58893a8ef47ff185ed9df1a17d136e7d1f6f7e8d9dae3a6"}
Jul 12 17:08:10.022827 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:10.022772    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz" podStartSLOduration=2.504266699 podStartE2EDuration="5.022737538s" totalImagesPullingTime="2.518470839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:08:10.02035152 +0000 UTC m=+338.222184779" watchObservedRunningTime="2026-07-12 17:08:10.022737538 +0000 UTC m=+338.224570794"
Jul 12 17:08:10.335969 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:10.335887    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:10.341878 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:10.341845    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:10.978480 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:10.978443    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:10.979640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:10.979613    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bnvlz"
Jul 12 17:08:11.458080 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:11.458048    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:08:11.458163 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:11.458138    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:08:11.984645 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:11.984593    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2" event={"ID":"557ea33c-ab20-431e-b97a-1287c5c86ff3","Type":"ContainerStarted","Data":"0c75d36d61635200ee2b17d06d17b42c5dd2b98ea17e42d94d616fd0948f6a3a"}
Jul 12 17:08:12.007595 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:12.007524    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2" podStartSLOduration=1.694177671 podStartE2EDuration="4.007505191s" totalImagesPullingTime="2.31332752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:08:12.005695336 +0000 UTC m=+340.207528606" watchObservedRunningTime="2026-07-12 17:08:12.007505191 +0000 UTC m=+340.209338448"
Jul 12 17:08:12.988904 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:12.988871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:08:12.990739 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:08:12.990718    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lkfb2"
Jul 12 17:09:14.173159 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.173125    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"]
Jul 12 17:09:14.176608 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.176590    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.179435 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.179414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 17:09:14.179538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.179418    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 17:09:14.180495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.180480    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2z6gm\""
Jul 12 17:09:14.183929 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.183792    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"]
Jul 12 17:09:14.260111 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.260074    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhkc4\" (UniqueName: \"kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.260300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.260125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.260300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.260213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.361152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.361117    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.361152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.361167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhkc4\" (UniqueName: \"kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.361360 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.361203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.361597 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.361577    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.361638 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.361593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.369897 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.369867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhkc4\" (UniqueName: \"kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.486333 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.486233    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:14.617470 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.617445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"]
Jul 12 17:09:14.619328 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:09:14.619294    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0d1f0e_6811_4d51_9e79_efa1cf3dbb5d.slice/crio-d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd WatchSource:0}: Error finding container d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd: Status 404 returned error can't find the container with id d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd
Jul 12 17:09:14.973603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.973572    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"]
Jul 12 17:09:14.976946 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.976930    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:14.986425 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:14.986403    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"]
Jul 12 17:09:15.066755 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.066717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.066755 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.066755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9nh\" (UniqueName: \"kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.066985 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.066843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.168087 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.168044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.168087 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.168088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9nh\" (UniqueName: \"kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.168299 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.168209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.168513 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.168487    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.168550 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.168523    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.176383 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.176357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9nh\" (UniqueName: \"kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.274569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.274482    2584 generic.go:356] "Generic (PLEG): container finished" podID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerID="e5f2b7a500bfd2443758dbf5be567c0b4eadd8b54bdd7ec35dde5d018379621c" exitCode=0
Jul 12 17:09:15.274569 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.274554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb" event={"ID":"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d","Type":"ContainerDied","Data":"e5f2b7a500bfd2443758dbf5be567c0b4eadd8b54bdd7ec35dde5d018379621c"}
Jul 12 17:09:15.274746 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.274603    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb" event={"ID":"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d","Type":"ContainerStarted","Data":"d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd"}
Jul 12 17:09:15.287270 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.287250    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:15.414321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.414297    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"]
Jul 12 17:09:15.416052 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:09:15.416023    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a83e0f_9095_4acd_a0d0_7f8c10643760.slice/crio-ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00 WatchSource:0}: Error finding container ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00: Status 404 returned error can't find the container with id ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00
Jul 12 17:09:15.574111 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.574022    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"]
Jul 12 17:09:15.577457 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.577435    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.585088 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.585062    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"]
Jul 12 17:09:15.672868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.672829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kj5\" (UniqueName: \"kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.672868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.672868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.673121 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.673017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.773795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.773746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.773954 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.773813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kj5\" (UniqueName: \"kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.773954 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.773834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.774168 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.774145    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.774206 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.774153    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.782514 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.782482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kj5\" (UniqueName: \"kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:15.887333 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:15.887283    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:16.051384 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.051359    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"]
Jul 12 17:09:16.052462 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:09:16.052436    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca0eebb_017c_4046_a28a_36f24c8e8ce2.slice/crio-a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a WatchSource:0}: Error finding container a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a: Status 404 returned error can't find the container with id a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a
Jul 12 17:09:16.280944 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.280912    2584 generic.go:356] "Generic (PLEG): container finished" podID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerID="d2298d998d9ba643647faf2f4a16e0fceb0cf4f111de4bf1b8ea053bf3a69211" exitCode=0
Jul 12 17:09:16.281366 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.280993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb" event={"ID":"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d","Type":"ContainerDied","Data":"d2298d998d9ba643647faf2f4a16e0fceb0cf4f111de4bf1b8ea053bf3a69211"}
Jul 12 17:09:16.282562 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.282544    2584 generic.go:356] "Generic (PLEG): container finished" podID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerID="19a7a77f26563b9f846c82fbb535b3d3fec2525b839a44ee50ca20795592900f" exitCode=0
Jul 12 17:09:16.282642 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.282624    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c" event={"ID":"0ca0eebb-017c-4046-a28a-36f24c8e8ce2","Type":"ContainerDied","Data":"19a7a77f26563b9f846c82fbb535b3d3fec2525b839a44ee50ca20795592900f"}
Jul 12 17:09:16.282704 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.282682    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c" event={"ID":"0ca0eebb-017c-4046-a28a-36f24c8e8ce2","Type":"ContainerStarted","Data":"a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a"}
Jul 12 17:09:16.284117 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.284095    2584 generic.go:356] "Generic (PLEG): container finished" podID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerID="1ef7a8693c16c62e23a4482edc00f469e05265e1ceb37d51e3039daa7f3ba2aa" exitCode=0
Jul 12 17:09:16.284211 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.284128    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerDied","Data":"1ef7a8693c16c62e23a4482edc00f469e05265e1ceb37d51e3039daa7f3ba2aa"}
Jul 12 17:09:16.284211 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.284161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerStarted","Data":"ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00"}
Jul 12 17:09:16.381213 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.381186    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"]
Jul 12 17:09:16.389538 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.389467    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.392302 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.392264    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"]
Jul 12 17:09:16.480559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.480522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.480559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.480562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjqg\" (UniqueName: \"kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.480751 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.480583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.581490 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.581452    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.581490 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.581491    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjqg\" (UniqueName: \"kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.581720 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.581511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.581901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.581882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.581939 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.581906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.590937 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.590912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjqg\" (UniqueName: \"kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.701935 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.701845    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:16.835245 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:16.835219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"]
Jul 12 17:09:16.887793 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:09:16.887743    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ee4f1_0875_482f_b81d_4789ba4f741b.slice/crio-57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb WatchSource:0}: Error finding container 57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb: Status 404 returned error can't find the container with id 57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb
Jul 12 17:09:17.291719 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.291636    2584 generic.go:356] "Generic (PLEG): container finished" podID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerID="1007e6db5c4b3da1ad3c37a0a177c8d94bbbdeab710e6d55f8bd7bfba51c288a" exitCode=0
Jul 12 17:09:17.291719 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.291711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm" event={"ID":"260ee4f1-0875-482f-b81d-4789ba4f741b","Type":"ContainerDied","Data":"1007e6db5c4b3da1ad3c37a0a177c8d94bbbdeab710e6d55f8bd7bfba51c288a"}
Jul 12 17:09:17.292185 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.291773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm" event={"ID":"260ee4f1-0875-482f-b81d-4789ba4f741b","Type":"ContainerStarted","Data":"57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb"}
Jul 12 17:09:17.294068 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.294039    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerStarted","Data":"bf3c991640a2399e181b4d46edaa39cadce377b7f8012f45001cf103ace067b4"}
Jul 12 17:09:17.296273 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.296244    2584 generic.go:356] "Generic (PLEG): container finished" podID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerID="61eb8ddf9c247ee5abaed5b7c4db0fc64590ec0370b08132daec9c9ff88b4376" exitCode=0
Jul 12 17:09:17.296355 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:17.296320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb" event={"ID":"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d","Type":"ContainerDied","Data":"61eb8ddf9c247ee5abaed5b7c4db0fc64590ec0370b08132daec9c9ff88b4376"}
Jul 12 17:09:18.303513 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.303414    2584 generic.go:356] "Generic (PLEG): container finished" podID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerID="ad15093397239e5b9e9fbde3ccfdb95194f63b36f0b7b9792362584e6585134a" exitCode=0
Jul 12 17:09:18.304006 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.303500    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c" event={"ID":"0ca0eebb-017c-4046-a28a-36f24c8e8ce2","Type":"ContainerDied","Data":"ad15093397239e5b9e9fbde3ccfdb95194f63b36f0b7b9792362584e6585134a"}
Jul 12 17:09:18.305419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.305401    2584 generic.go:356] "Generic (PLEG): container finished" podID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerID="92518ce66aa5aa2e1c17fe6bae44bc1d2b570db57bff11091c437957b69b4e54" exitCode=0
Jul 12 17:09:18.305501 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.305479    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm" event={"ID":"260ee4f1-0875-482f-b81d-4789ba4f741b","Type":"ContainerDied","Data":"92518ce66aa5aa2e1c17fe6bae44bc1d2b570db57bff11091c437957b69b4e54"}
Jul 12 17:09:18.307252 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.307232    2584 generic.go:356] "Generic (PLEG): container finished" podID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerID="bf3c991640a2399e181b4d46edaa39cadce377b7f8012f45001cf103ace067b4" exitCode=0
Jul 12 17:09:18.307355 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.307316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerDied","Data":"bf3c991640a2399e181b4d46edaa39cadce377b7f8012f45001cf103ace067b4"}
Jul 12 17:09:18.596122 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.596058    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:18.699335 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.699302    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhkc4\" (UniqueName: \"kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4\") pod \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") "
Jul 12 17:09:18.699502 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.699354    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle\") pod \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") "
Jul 12 17:09:18.699502 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.699400    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util\") pod \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\" (UID: \"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d\") "
Jul 12 17:09:18.700052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.700024    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle" (OuterVolumeSpecName: "bundle") pod "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" (UID: "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:18.701598 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.701577    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4" (OuterVolumeSpecName: "kube-api-access-nhkc4") pod "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" (UID: "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d"). InnerVolumeSpecName "kube-api-access-nhkc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:09:18.704232 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.704200    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util" (OuterVolumeSpecName: "util") pod "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" (UID: "bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:18.800932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.800893    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:18.800932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.800927    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhkc4\" (UniqueName: \"kubernetes.io/projected/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-kube-api-access-nhkc4\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:18.800932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:18.800937    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:19.317986 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.317956    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb"
Jul 12 17:09:19.318404 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.317983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb" event={"ID":"bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d","Type":"ContainerDied","Data":"d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd"}
Jul 12 17:09:19.318404 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.318035    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d09fac7cbfe0e88243ec16d36bce61b377c3ddca850129c952f7a34daf9d0cdd"
Jul 12 17:09:19.320280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.320239    2584 generic.go:356] "Generic (PLEG): container finished" podID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerID="0ad08c5a2cf62e8338dd57276b7ca36a343dc6723c18e2b9d94374d73413cae2" exitCode=0
Jul 12 17:09:19.320437 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.320314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c" event={"ID":"0ca0eebb-017c-4046-a28a-36f24c8e8ce2","Type":"ContainerDied","Data":"0ad08c5a2cf62e8338dd57276b7ca36a343dc6723c18e2b9d94374d73413cae2"}
Jul 12 17:09:19.322398 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.322373    2584 generic.go:356] "Generic (PLEG): container finished" podID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerID="696ca5c9f45086381231009123985323479a2e05824036c595b854ead7d59908" exitCode=0
Jul 12 17:09:19.322525 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.322451    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm" event={"ID":"260ee4f1-0875-482f-b81d-4789ba4f741b","Type":"ContainerDied","Data":"696ca5c9f45086381231009123985323479a2e05824036c595b854ead7d59908"}
Jul 12 17:09:19.324669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.324643    2584 generic.go:356] "Generic (PLEG): container finished" podID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerID="6050409654d09216a83026a23d5a3901645751a5a7f0003e54708ed0f0875840" exitCode=0
Jul 12 17:09:19.324827 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:19.324682    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerDied","Data":"6050409654d09216a83026a23d5a3901645751a5a7f0003e54708ed0f0875840"}
Jul 12 17:09:20.484288 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.484244    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:20.515949 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.515927    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle\") pod \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") "
Jul 12 17:09:20.516032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.515970    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6kj5\" (UniqueName: \"kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5\") pod \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") "
Jul 12 17:09:20.516032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.516005    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util\") pod \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\" (UID: \"0ca0eebb-017c-4046-a28a-36f24c8e8ce2\") "
Jul 12 17:09:20.516433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.516405    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle" (OuterVolumeSpecName: "bundle") pod "0ca0eebb-017c-4046-a28a-36f24c8e8ce2" (UID: "0ca0eebb-017c-4046-a28a-36f24c8e8ce2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.517989 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.517967    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5" (OuterVolumeSpecName: "kube-api-access-k6kj5") pod "0ca0eebb-017c-4046-a28a-36f24c8e8ce2" (UID: "0ca0eebb-017c-4046-a28a-36f24c8e8ce2"). InnerVolumeSpecName "kube-api-access-k6kj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:09:20.521893 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.521871    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util" (OuterVolumeSpecName: "util") pod "0ca0eebb-017c-4046-a28a-36f24c8e8ce2" (UID: "0ca0eebb-017c-4046-a28a-36f24c8e8ce2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.542319 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.542291    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:20.544845 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.544826    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:20.616816 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.616785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle\") pod \"44a83e0f-9095-4acd-a0d0-7f8c10643760\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") "
Jul 12 17:09:20.616991 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.616871    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util\") pod \"44a83e0f-9095-4acd-a0d0-7f8c10643760\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") "
Jul 12 17:09:20.616991 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.616914    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util\") pod \"260ee4f1-0875-482f-b81d-4789ba4f741b\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") "
Jul 12 17:09:20.616991 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.616960    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle\") pod \"260ee4f1-0875-482f-b81d-4789ba4f741b\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") "
Jul 12 17:09:20.616991 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.616987    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qjqg\" (UniqueName: \"kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg\") pod \"260ee4f1-0875-482f-b81d-4789ba4f741b\" (UID: \"260ee4f1-0875-482f-b81d-4789ba4f741b\") "
Jul 12 17:09:20.617194 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617024    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl9nh\" (UniqueName: \"kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh\") pod \"44a83e0f-9095-4acd-a0d0-7f8c10643760\" (UID: \"44a83e0f-9095-4acd-a0d0-7f8c10643760\") "
Jul 12 17:09:20.617250 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617228    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.617300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617245    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6kj5\" (UniqueName: \"kubernetes.io/projected/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-kube-api-access-k6kj5\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.617300 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617262    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0eebb-017c-4046-a28a-36f24c8e8ce2-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.617492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617458    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle" (OuterVolumeSpecName: "bundle") pod "44a83e0f-9095-4acd-a0d0-7f8c10643760" (UID: "44a83e0f-9095-4acd-a0d0-7f8c10643760"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.617607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.617510    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle" (OuterVolumeSpecName: "bundle") pod "260ee4f1-0875-482f-b81d-4789ba4f741b" (UID: "260ee4f1-0875-482f-b81d-4789ba4f741b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.619204 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.619181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh" (OuterVolumeSpecName: "kube-api-access-xl9nh") pod "44a83e0f-9095-4acd-a0d0-7f8c10643760" (UID: "44a83e0f-9095-4acd-a0d0-7f8c10643760"). InnerVolumeSpecName "kube-api-access-xl9nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:09:20.619471 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.619445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg" (OuterVolumeSpecName: "kube-api-access-6qjqg") pod "260ee4f1-0875-482f-b81d-4789ba4f741b" (UID: "260ee4f1-0875-482f-b81d-4789ba4f741b"). InnerVolumeSpecName "kube-api-access-6qjqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:09:20.622769 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.622735    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util" (OuterVolumeSpecName: "util") pod "44a83e0f-9095-4acd-a0d0-7f8c10643760" (UID: "44a83e0f-9095-4acd-a0d0-7f8c10643760"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.623561 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.623540    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util" (OuterVolumeSpecName: "util") pod "260ee4f1-0875-482f-b81d-4789ba4f741b" (UID: "260ee4f1-0875-482f-b81d-4789ba4f741b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:09:20.718586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718549    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.718586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718582    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qjqg\" (UniqueName: \"kubernetes.io/projected/260ee4f1-0875-482f-b81d-4789ba4f741b-kube-api-access-6qjqg\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.718586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718592    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl9nh\" (UniqueName: \"kubernetes.io/projected/44a83e0f-9095-4acd-a0d0-7f8c10643760-kube-api-access-xl9nh\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.718861 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718601    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-bundle\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.718861 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718609    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44a83e0f-9095-4acd-a0d0-7f8c10643760-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:20.718861 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:20.718617    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/260ee4f1-0875-482f-b81d-4789ba4f741b-util\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:09:21.336927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.336890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c" event={"ID":"0ca0eebb-017c-4046-a28a-36f24c8e8ce2","Type":"ContainerDied","Data":"a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a"}
Jul 12 17:09:21.337118 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.336946    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a122cd46aa4899aff2402216de2b482fc1aeb6f609e1c69ce5862b0e776e973a"
Jul 12 17:09:21.337118 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.336898    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c"
Jul 12 17:09:21.338777 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.338738    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm"
Jul 12 17:09:21.338777 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.338743    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm" event={"ID":"260ee4f1-0875-482f-b81d-4789ba4f741b","Type":"ContainerDied","Data":"57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb"}
Jul 12 17:09:21.338939 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.338805    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57334b8ba0c7f3ee638afe494c72ae2baf3a9db0446e644ffa2384f09fdf96cb"
Jul 12 17:09:21.340748 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.340729    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4"
Jul 12 17:09:21.340862 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.340740    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4" event={"ID":"44a83e0f-9095-4acd-a0d0-7f8c10643760","Type":"ContainerDied","Data":"ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00"}
Jul 12 17:09:21.340862 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:09:21.340805    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca25d6ebb8f9bad45a0f7e1789f6c815448632a80cf3020417b5ec134184af00"
Jul 12 17:10:19.370798 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.370733    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"]
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371158    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371172    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371184    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371189    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371199    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371204    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371213    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371218    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371225    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371230    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371239    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371244    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="extract"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371250    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371255    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371264    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371268    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371276    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371280    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371287    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371293    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371301    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371306    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="util"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371311    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="pull"
Jul 12 17:10:19.371334 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371316    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="pull"
Jul 12 17:10:19.372540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371392    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="260ee4f1-0875-482f-b81d-4789ba4f741b" containerName="extract"
Jul 12 17:10:19.372540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371400    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a83e0f-9095-4acd-a0d0-7f8c10643760" containerName="extract"
Jul 12 17:10:19.372540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371407    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca0eebb-017c-4046-a28a-36f24c8e8ce2" containerName="extract"
Jul 12 17:10:19.372540 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.371413    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d" containerName="extract"
Jul 12 17:10:19.374403 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.374382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.377177 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.377153    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2cjwm\""
Jul 12 17:10:19.386206 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.386180    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"]
Jul 12 17:10:19.419265 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419265 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419325    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqkc2\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-kube-api-access-bqkc2\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419532 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.419853 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.419551    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520113    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqkc2\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-kube-api-access-bqkc2\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520317    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520335    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520696 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520890 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520862    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.520977 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.520895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.521067 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.521051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.521120 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.521103    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.522656 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.522623    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.522841 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.522826    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.528661 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.528631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.528806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.528790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqkc2\" (UniqueName: \"kubernetes.io/projected/0961c9de-6beb-46ae-9128-f6fc8c00dcac-kube-api-access-bqkc2\") pod \"maas-default-gateway-openshift-default-56654dcf7-6vrq6\" (UID: \"0961c9de-6beb-46ae-9128-f6fc8c00dcac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.685835 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.685724    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:19.826901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.826863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"]
Jul 12 17:10:19.832423 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:10:19.832396    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0961c9de_6beb_46ae_9128_f6fc8c00dcac.slice/crio-c249c1fd82183cb1f9431c1d91a9b2b968937110f85c4a59657b36f5ab9cfe5d WatchSource:0}: Error finding container c249c1fd82183cb1f9431c1d91a9b2b968937110f85c4a59657b36f5ab9cfe5d: Status 404 returned error can't find the container with id c249c1fd82183cb1f9431c1d91a9b2b968937110f85c4a59657b36f5ab9cfe5d
Jul 12 17:10:19.834740 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.834712    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:10:19.834852 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.834808    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:10:19.834917 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:19.834854    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:10:20.636586 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:20.636546    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" event={"ID":"0961c9de-6beb-46ae-9128-f6fc8c00dcac","Type":"ContainerStarted","Data":"65fc612db7c97fb0f00255fa32ac663030a8ba334e9c06b6310c44721f8f224b"}
Jul 12 17:10:20.637011 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:20.636607    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" event={"ID":"0961c9de-6beb-46ae-9128-f6fc8c00dcac","Type":"ContainerStarted","Data":"c249c1fd82183cb1f9431c1d91a9b2b968937110f85c4a59657b36f5ab9cfe5d"}
Jul 12 17:10:20.657062 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:20.657009    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" podStartSLOduration=1.656990216 podStartE2EDuration="1.656990216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:10:20.655964852 +0000 UTC m=+468.857798110" watchObservedRunningTime="2026-07-12 17:10:20.656990216 +0000 UTC m=+468.858823578"
Jul 12 17:10:20.686544 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:20.686509    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:20.691371 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:20.691346    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:21.641555 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:21.641521    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:10:21.642442 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:10:21.642423    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:11:56.119896 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.119859    2584 generic.go:356] "Generic (PLEG): container finished" podID="0961c9de-6beb-46ae-9128-f6fc8c00dcac" containerID="65fc612db7c97fb0f00255fa32ac663030a8ba334e9c06b6310c44721f8f224b" exitCode=0
Jul 12 17:11:56.120429 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.119941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" event={"ID":"0961c9de-6beb-46ae-9128-f6fc8c00dcac","Type":"ContainerDied","Data":"65fc612db7c97fb0f00255fa32ac663030a8ba334e9c06b6310c44721f8f224b"}
Jul 12 17:11:56.120498 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.120459    2584 scope.go:117] "RemoveContainer" containerID="65fc612db7c97fb0f00255fa32ac663030a8ba334e9c06b6310c44721f8f224b"
Jul 12 17:11:56.121457 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.121429    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:11:56.121555 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.121492    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:11:56.121555 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:56.121523    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:11:57.125976 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:57.125935    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" event={"ID":"0961c9de-6beb-46ae-9128-f6fc8c00dcac","Type":"ContainerStarted","Data":"0541755a436c0d38c9eb1401e75233c8517617ff5c1c0c5ef276e2d3c852fa9c"}
Jul 12 17:11:57.686643 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:57.686604    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:11:57.686964 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:57.686940    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6vrq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 12 17:11:57.687022 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:57.686990    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" podUID="0961c9de-6beb-46ae-9128-f6fc8c00dcac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 12 17:11:58.686505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:58.686464    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6vrq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 12 17:11:58.686923 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:58.686522    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" podUID="0961c9de-6beb-46ae-9128-f6fc8c00dcac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 12 17:11:59.687070 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:59.687031    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6vrq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 12 17:11:59.687447 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:11:59.687118    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" podUID="0961c9de-6beb-46ae-9128-f6fc8c00dcac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 12 17:12:00.686467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:00.686425    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6vrq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 12 17:12:00.686650 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:00.686488    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6" podUID="0961c9de-6beb-46ae-9128-f6fc8c00dcac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 12 17:12:01.690397 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:01.690360    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:12:01.690887 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:01.690866    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:12:01.691676 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:01.691653    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6vrq6"
Jul 12 17:12:14.989588 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.989553    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"]
Jul 12 17:12:14.993055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.993037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:14.995708 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.995688    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 17:12:14.996944 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.996922    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5kh7x\""
Jul 12 17:12:14.997034 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.996948    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 12 17:12:14.997034 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:14.997005    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 17:12:15.002956 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.002932    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"]
Jul 12 17:12:15.121861 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.121820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.121861 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.121863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.122069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.121894    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.122069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.121927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn48h\" (UniqueName: \"kubernetes.io/projected/f253aa89-ba1f-4f76-baa6-d066a2e33553-kube-api-access-sn48h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.122069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.121977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f253aa89-ba1f-4f76-baa6-d066a2e33553-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.122069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.122027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.222919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.222885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f253aa89-ba1f-4f76-baa6-d066a2e33553-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.222919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.222921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223151 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.222967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223151 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.222984    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223151 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.223004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223151 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.223023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn48h\" (UniqueName: \"kubernetes.io/projected/f253aa89-ba1f-4f76-baa6-d066a2e33553-kube-api-access-sn48h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223454 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.223419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223454 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.223447    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.223604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.223430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.225288 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.225272    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f253aa89-ba1f-4f76-baa6-d066a2e33553-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.225429 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.225413    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f253aa89-ba1f-4f76-baa6-d066a2e33553-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.230644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.230627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn48h\" (UniqueName: \"kubernetes.io/projected/f253aa89-ba1f-4f76-baa6-d066a2e33553-kube-api-access-sn48h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mkhcn\" (UID: \"f253aa89-ba1f-4f76-baa6-d066a2e33553\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.304265 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.304171    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:15.434881 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:15.434856    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"]
Jul 12 17:12:15.436822 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:12:15.436793    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf253aa89_ba1f_4f76_baa6_d066a2e33553.slice/crio-cd9fee12cbcdaea4961e8aef72b6c101db3ac094757b571d1fd0a06d8268e82f WatchSource:0}: Error finding container cd9fee12cbcdaea4961e8aef72b6c101db3ac094757b571d1fd0a06d8268e82f: Status 404 returned error can't find the container with id cd9fee12cbcdaea4961e8aef72b6c101db3ac094757b571d1fd0a06d8268e82f
Jul 12 17:12:16.229648 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:16.229609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn" event={"ID":"f253aa89-ba1f-4f76-baa6-d066a2e33553","Type":"ContainerStarted","Data":"cd9fee12cbcdaea4961e8aef72b6c101db3ac094757b571d1fd0a06d8268e82f"}
Jul 12 17:12:17.236203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:17.236162    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn" event={"ID":"f253aa89-ba1f-4f76-baa6-d066a2e33553","Type":"ContainerStarted","Data":"8777d5bf227b8bf4131a24552e6ac9fb5eed2b9dc808703a24bc7067056576dd"}
Jul 12 17:12:17.254260 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:17.254202    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn" podStartSLOduration=2.239917345 podStartE2EDuration="3.254184221s" totalImagesPullingTime="1.014266876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:12:17.252507892 +0000 UTC m=+585.454341149" watchObservedRunningTime="2026-07-12 17:12:17.254184221 +0000 UTC m=+585.456017523"
Jul 12 17:12:22.898204 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.898167    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"]
Jul 12 17:12:22.901749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.901728    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.904357 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.904333    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 17:12:22.911687 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.911664    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"]
Jul 12 17:12:22.997053 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997008    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418c814d-a4e4-4bbc-b743-3edbb2834640-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.997234 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.997234 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997199    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.997322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.997378 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:22.997467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:22.997439    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zqg\" (UniqueName: \"kubernetes.io/projected/418c814d-a4e4-4bbc-b743-3edbb2834640-kube-api-access-t5zqg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098214 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098214 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098469 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098469 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zqg\" (UniqueName: \"kubernetes.io/projected/418c814d-a4e4-4bbc-b743-3edbb2834640-kube-api-access-t5zqg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098469 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418c814d-a4e4-4bbc-b743-3edbb2834640-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098626 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098626 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098647    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.098744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.098691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.100696 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.100670    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/418c814d-a4e4-4bbc-b743-3edbb2834640-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.100883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.100866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418c814d-a4e4-4bbc-b743-3edbb2834640-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.106567 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.106546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zqg\" (UniqueName: \"kubernetes.io/projected/418c814d-a4e4-4bbc-b743-3edbb2834640-kube-api-access-t5zqg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-79tdh\" (UID: \"418c814d-a4e4-4bbc-b743-3edbb2834640\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.213157 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.213061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:23.349213 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:23.349180    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"]
Jul 12 17:12:23.351809 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:12:23.351787    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418c814d_a4e4_4bbc_b743_3edbb2834640.slice/crio-05530f32debc96fcb6821cae301fee444eb69fc3da715d4dccc02255bba79cd3 WatchSource:0}: Error finding container 05530f32debc96fcb6821cae301fee444eb69fc3da715d4dccc02255bba79cd3: Status 404 returned error can't find the container with id 05530f32debc96fcb6821cae301fee444eb69fc3da715d4dccc02255bba79cd3
Jul 12 17:12:24.274819 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:24.274777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh" event={"ID":"418c814d-a4e4-4bbc-b743-3edbb2834640","Type":"ContainerStarted","Data":"e11bb3f6f504f50dc40951229bb0448b515233636eaba8df8d2ca769c6dc54ba"}
Jul 12 17:12:24.275281 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:24.274839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh" event={"ID":"418c814d-a4e4-4bbc-b743-3edbb2834640","Type":"ContainerStarted","Data":"05530f32debc96fcb6821cae301fee444eb69fc3da715d4dccc02255bba79cd3"}
Jul 12 17:12:24.297980 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:24.297929    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh" podStartSLOduration=2.106009234 podStartE2EDuration="2.297912818s" totalImagesPullingTime="191.903584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:12:24.295857438 +0000 UTC m=+592.497690695" watchObservedRunningTime="2026-07-12 17:12:24.297912818 +0000 UTC m=+592.499746107"
Jul 12 17:12:25.305211 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:25.305179    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:25.305621 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:25.305233    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:25.317767 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:25.317736    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:26.296256 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:26.296220    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mkhcn"
Jul 12 17:12:32.346251 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:32.346218    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:12:32.350832 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:32.350805    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:12:33.213252 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:33.213213    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:33.213433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:33.213287    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:33.225616 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:33.225579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:12:33.332328 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:12:33.332292    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-79tdh"
Jul 12 17:17:32.382367 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:17:32.382295    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:17:32.392062 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:17:32.392037    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:22:32.425209 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:22:32.425101    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:22:32.431830 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:22:32.431805    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:26:55.628932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.628891    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:26:55.632952 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.632928    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.635628 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.635605    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2c119f77-openshift-default-dockercfg-dqbwb\""
Jul 12 17:26:55.646837 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.646812    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:26:55.704550 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704648    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704680    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704894 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704894 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmntb\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.704960 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.704912    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806324 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806505 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806879 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806879 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmntb\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806879 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.806879 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.807059 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.806913    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.807059 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.807028    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.807397 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.807376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.808683 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.808665    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.809044 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.809026    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.818721 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.818701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.818843 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.818754    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmntb\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb\") pod \"e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") " pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:55.943845 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:55.943713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:56.081169 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.081137    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:26:56.082515 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:26:56.082488    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25292c0a_a342_4e83_826f_d3f9b531f164.slice/crio-4815c9504a2e53cc2bb20182da54174907cad35c03a2208b2fe469274fdecc32 WatchSource:0}: Error finding container 4815c9504a2e53cc2bb20182da54174907cad35c03a2208b2fe469274fdecc32: Status 404 returned error can't find the container with id 4815c9504a2e53cc2bb20182da54174907cad35c03a2208b2fe469274fdecc32
Jul 12 17:26:56.084523 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.084485    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:26:56.084582 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.084554    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:26:56.084622 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.084586    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:26:56.668393 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.668356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerStarted","Data":"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"}
Jul 12 17:26:56.668795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.668416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerStarted","Data":"4815c9504a2e53cc2bb20182da54174907cad35c03a2208b2fe469274fdecc32"}
Jul 12 17:26:56.690852 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.690797    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podStartSLOduration=1.690782588 podStartE2EDuration="1.690782588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:26:56.687559531 +0000 UTC m=+1464.889392811" watchObservedRunningTime="2026-07-12 17:26:56.690782588 +0000 UTC m=+1464.892615839"
Jul 12 17:26:56.944860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:56.944752    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:57.949808 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:57.949774    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:58.684619 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:58.684582    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:26:58.685666 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:26:58.685644    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:07.731105 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.731010    2584 generic.go:356] "Generic (PLEG): container finished" podID="25292c0a-a342-4e83-826f-d3f9b531f164" containerID="a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e" exitCode=0
Jul 12 17:27:07.731105 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.731087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerDied","Data":"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"}
Jul 12 17:27:07.731513 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.731455    2584 scope.go:117] "RemoveContainer" containerID="a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"
Jul 12 17:27:07.732483 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.732458    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:07.732548 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.732525    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:07.732584 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:07.732556    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:08.741252 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:08.741205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerStarted","Data":"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"}
Jul 12 17:27:08.944808 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:08.944753    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:08.945874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:08.945837    2584 patch_prober.go:28] interesting pod/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 12 17:27:08.946015 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:08.945914    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 12 17:27:09.944797 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:09.944743    2584 patch_prober.go:28] interesting pod/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 12 17:27:09.945344 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:09.945314    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 12 17:27:10.944590 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:10.944535    2584 patch_prober.go:28] interesting pod/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 12 17:27:10.944836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:10.944606    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 12 17:27:11.944953 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:11.944470    2584 patch_prober.go:28] interesting pod/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 12 17:27:11.944953 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:11.944538    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 12 17:27:12.948409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:12.948378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:12.948823 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:12.948646    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:12.949256 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:12.949235    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:27.145313 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.145274    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:27:27.145862 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.145479    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" containerID="cri-o://eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e" gracePeriod=30
Jul 12 17:27:27.692222 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.692187    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:27:27.695712 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.695690    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.698322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.698297    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dc65b9aa-gw-openshift-default-dockercfg-6rhx5\""
Jul 12 17:27:27.711305 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.711280    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:27:27.717116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717093    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717168    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z779\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717219    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717279    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.717415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.717321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.817994 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.817958    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.817994 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.817992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z779\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818345 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818263    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818345 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818345 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818399    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818431    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818495 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.818825 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.818750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.819332 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.819308    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.821643 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.821597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.822487 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.822460    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.836656 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.836619    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.836841 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.836724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z779\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779\") pod \"e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") " pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:27.951717 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.951625    2584 patch_prober.go:28] interesting pod/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 17:27:27.951717 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:27.951680    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 17:27:28.006304 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.006268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:28.151509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.151485    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:27:28.152688 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:27:28.152659    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca65ac65_cdd3_4484_afc8_e911cc71440b.slice/crio-734de9bc0d1bc3240664112ff64b42f39ba51eed7db0741c139f098d5cc6d8a7 WatchSource:0}: Error finding container 734de9bc0d1bc3240664112ff64b42f39ba51eed7db0741c139f098d5cc6d8a7: Status 404 returned error can't find the container with id 734de9bc0d1bc3240664112ff64b42f39ba51eed7db0741c139f098d5cc6d8a7
Jul 12 17:27:28.154752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.154724    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:28.154868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.154810    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:28.154868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.154853    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:28.853573 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.853530    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerStarted","Data":"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"}
Jul 12 17:27:28.853752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.853591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerStarted","Data":"734de9bc0d1bc3240664112ff64b42f39ba51eed7db0741c139f098d5cc6d8a7"}
Jul 12 17:27:28.875535 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:28.875463    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podStartSLOduration=1.8754367109999999 podStartE2EDuration="1.875436711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:27:28.871882401 +0000 UTC m=+1497.073715659" watchObservedRunningTime="2026-07-12 17:27:28.875436711 +0000 UTC m=+1497.077269968"
Jul 12 17:27:29.006593 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:29.006556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:29.011440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:29.011410    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:29.858276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:29.858242    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:29.859418 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:29.859393    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:32.426592 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.426570    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:32.457999 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.457959    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmntb\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458058    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458128    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458191    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458219    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458256    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458284    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.458419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.458329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket\") pod \"25292c0a-a342-4e83-826f-d3f9b531f164\" (UID: \"25292c0a-a342-4e83-826f-d3f9b531f164\") "
Jul 12 17:27:32.459509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.459460    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:27:32.459509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.459487    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:27:32.459914 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.459698    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:27:32.459914 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.459732    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:27:32.460227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.460062    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data" (OuterVolumeSpecName: "istio-data") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:27:32.461281 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.461236    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb" (OuterVolumeSpecName: "kube-api-access-tmntb") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "kube-api-access-tmntb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:27:32.462138 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.462113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 17:27:32.462231 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.462181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:27:32.462317 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.462296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token" (OuterVolumeSpecName: "istio-token") pod "25292c0a-a342-4e83-826f-d3f9b531f164" (UID: "25292c0a-a342-4e83-826f-d3f9b531f164"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:27:32.496864 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.496832    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:27:32.498004 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.497977    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:27:32.559431 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559396    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25292c0a-a342-4e83-826f-d3f9b531f164-istiod-ca-cert\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559431 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559426    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559431 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559435    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmntb\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-kube-api-access-tmntb\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559447    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25292c0a-a342-4e83-826f-d3f9b531f164-istio-token\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559456    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-credential-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559464    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-data\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559473    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25292c0a-a342-4e83-826f-d3f9b531f164-istio-podinfo\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559480    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-workload-certs\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.559665 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.559487    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25292c0a-a342-4e83-826f-d3f9b531f164-istio-envoy\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:27:32.875103 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.875068    2584 generic.go:356] "Generic (PLEG): container finished" podID="25292c0a-a342-4e83-826f-d3f9b531f164" containerID="eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e" exitCode=0
Jul 12 17:27:32.875280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.875121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerDied","Data":"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"}
Jul 12 17:27:32.875280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.875130    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"
Jul 12 17:27:32.875280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.875188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4" event={"ID":"25292c0a-a342-4e83-826f-d3f9b531f164","Type":"ContainerDied","Data":"4815c9504a2e53cc2bb20182da54174907cad35c03a2208b2fe469274fdecc32"}
Jul 12 17:27:32.875280 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.875212    2584 scope.go:117] "RemoveContainer" containerID="eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"
Jul 12 17:27:32.884288 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.884262    2584 scope.go:117] "RemoveContainer" containerID="a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"
Jul 12 17:27:32.892039 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.892020    2584 scope.go:117] "RemoveContainer" containerID="eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"
Jul 12 17:27:32.892305 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:27:32.892287    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e\": container with ID starting with eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e not found: ID does not exist" containerID="eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"
Jul 12 17:27:32.892354 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.892314    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e"} err="failed to get container status \"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e\": rpc error: code = NotFound desc = could not find container \"eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e\": container with ID starting with eeec11d128ef0bfeb122de63711d7eeb7e1edea6896627cfa9b7d9f6c5dda91e not found: ID does not exist"
Jul 12 17:27:32.892354 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.892329    2584 scope.go:117] "RemoveContainer" containerID="a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"
Jul 12 17:27:32.892550 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:27:32.892533    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e\": container with ID starting with a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e not found: ID does not exist" containerID="a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"
Jul 12 17:27:32.892592 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.892555    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e"} err="failed to get container status \"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e\": rpc error: code = NotFound desc = could not find container \"a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e\": container with ID starting with a486c4806a4fc413c5da3bfcee05bb64d6d0b51b0f857c2fc4c4456e0487969e not found: ID does not exist"
Jul 12 17:27:32.897836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.897815    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:27:32.900974 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:32.900954    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2c119f77-openshift-default-589cccf8c5-lddr4"]
Jul 12 17:27:34.379089 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:34.379058    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" path="/var/lib/kubelet/pods/25292c0a-a342-4e83-826f-d3f9b531f164/volumes"
Jul 12 17:27:39.914084 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.914048    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerID="e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8" exitCode=0
Jul 12 17:27:39.914493 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.914117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerDied","Data":"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"}
Jul 12 17:27:39.914552 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.914536    2584 scope.go:117] "RemoveContainer" containerID="e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"
Jul 12 17:27:39.915595 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.915564    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:39.915697 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.915647    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:39.915697 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:39.915684    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:27:40.922195 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:40.922161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerStarted","Data":"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"}
Jul 12 17:27:41.006692 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:41.006652    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:41.007608 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:41.007581    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 12 17:27:41.007707 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:41.007633    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 12 17:27:42.006672 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:42.006637    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 12 17:27:42.007091 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:42.006692    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 12 17:27:43.007246 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:43.007210    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 12 17:27:43.007648 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:43.007281    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 12 17:27:44.006688 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:44.006645    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 12 17:27:44.006927 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:44.006707    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 12 17:27:44.858554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:44.858511    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:45.007177 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:45.007135    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 12 17:27:45.007381 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:45.007198    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 12 17:27:46.010732 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:46.010699    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:27:46.011601 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:27:46.011581    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:28:33.759192 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:33.759154    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:28:33.759682 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:33.759360    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy" containerID="cri-o://b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7" gracePeriod=30
Jul 12 17:28:39.007388 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.007360    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:28:39.034737 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034661    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034737 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034713    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034747    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034800    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034840    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034884    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z779\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.034968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.034916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.035467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.035003    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.035467 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.035060    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs\") pod \"ca65ac65-cdd3-4484-afc8-e911cc71440b\" (UID: \"ca65ac65-cdd3-4484-afc8-e911cc71440b\") "
Jul 12 17:28:39.035574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.035550    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:28:39.035702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.035638    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:28:39.035702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.035690    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:28:39.036101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.036074    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:28:39.036194 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.036142    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:28:39.038067 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.038034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:28:39.038316 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.038287    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 17:28:39.038447 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.038432    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:28:39.038533 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.038514    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779" (OuterVolumeSpecName: "kube-api-access-9z779") pod "ca65ac65-cdd3-4484-afc8-e911cc71440b" (UID: "ca65ac65-cdd3-4484-afc8-e911cc71440b"). InnerVolumeSpecName "kube-api-access-9z779". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:28:39.136828 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136788    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.136828 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136820    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca65ac65-cdd3-4484-afc8-e911cc71440b-istiod-ca-cert\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.136828 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136829    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-envoy\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.136828 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136837    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-data\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.137144 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136845    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-podinfo\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.137144 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136853    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z779\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-kube-api-access-9z779\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.137144 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136862    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-credential-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.137144 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136870    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca65ac65-cdd3-4484-afc8-e911cc71440b-istio-token\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.137144 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.136878    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca65ac65-cdd3-4484-afc8-e911cc71440b-workload-certs\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:28:39.225393 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.225361    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerID="b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7" exitCode=0
Jul 12 17:28:39.225551 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.225411    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"
Jul 12 17:28:39.225551 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.225429    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerDied","Data":"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"}
Jul 12 17:28:39.225551 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.225471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k" event={"ID":"ca65ac65-cdd3-4484-afc8-e911cc71440b","Type":"ContainerDied","Data":"734de9bc0d1bc3240664112ff64b42f39ba51eed7db0741c139f098d5cc6d8a7"}
Jul 12 17:28:39.225551 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.225492    2584 scope.go:117] "RemoveContainer" containerID="b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"
Jul 12 17:28:39.238032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.238011    2584 scope.go:117] "RemoveContainer" containerID="e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"
Jul 12 17:28:39.246042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.246020    2584 scope.go:117] "RemoveContainer" containerID="b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"
Jul 12 17:28:39.246294 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:28:39.246275    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7\": container with ID starting with b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7 not found: ID does not exist" containerID="b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"
Jul 12 17:28:39.246360 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.246302    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7"} err="failed to get container status \"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7\": rpc error: code = NotFound desc = could not find container \"b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7\": container with ID starting with b38de5ab4134e1f3a60c6beaf8e59abdcc6921189e636dd534f048d4bc75c4c7 not found: ID does not exist"
Jul 12 17:28:39.246360 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.246324    2584 scope.go:117] "RemoveContainer" containerID="e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"
Jul 12 17:28:39.246591 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:28:39.246569    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8\": container with ID starting with e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8 not found: ID does not exist" containerID="e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"
Jul 12 17:28:39.246645 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.246597    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8"} err="failed to get container status \"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8\": rpc error: code = NotFound desc = could not find container \"e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8\": container with ID starting with e621c872ca01d9b9f7cc0fd0d0ad3395faade8df986d5b081dea9438e6d6f8b8 not found: ID does not exist"
Jul 12 17:28:39.257424 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.257400    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:28:39.277086 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.277060    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dc65b9aa-gw-openshift-default-5684f9fd5f-rl45k"]
Jul 12 17:28:39.889618 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.889587    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:28:39.890001 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.889980    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.890001 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890000    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890026    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890035    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890049    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890057    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890154    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890167    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890175    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.890216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.890184    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" containerName="istio-proxy"
Jul 12 17:28:39.895111 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.895089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.898002 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.897971    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-187a6623-openshift-default-dockercfg-58ttz\""
Jul 12 17:28:39.906373 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.906350    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:28:39.943409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943525    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swnk9\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943607 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943784 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:39.943784 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:39.943656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.044744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.044744 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044795    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swnk9\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044898    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.044971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045266 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045185    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045788 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045788 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045393    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.045897 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.045810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.047253 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.047220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.047358 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.047345    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.052964 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.052940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.053545 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.053526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swnk9\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9\") pod \"e2e-ait-187a6623-openshift-default-598bb4b59-2r94j\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") " pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.206807 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.206685    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:40.345655 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.345631    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:28:40.347218 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:28:40.347190    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d246e87_1ea1_4b5f_8610_255a2abc9287.slice/crio-bc069e686dcd5333b4a61fd4c650c38404272f9aac6d636ca1c41b4edee8034f WatchSource:0}: Error finding container bc069e686dcd5333b4a61fd4c650c38404272f9aac6d636ca1c41b4edee8034f: Status 404 returned error can't find the container with id bc069e686dcd5333b4a61fd4c650c38404272f9aac6d636ca1c41b4edee8034f
Jul 12 17:28:40.349812 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.349781    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:40.349916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.349855    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:40.349916 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.349904    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:40.379226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:40.379196    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca65ac65-cdd3-4484-afc8-e911cc71440b" path="/var/lib/kubelet/pods/ca65ac65-cdd3-4484-afc8-e911cc71440b/volumes"
Jul 12 17:28:41.241126 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:41.241087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerStarted","Data":"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"}
Jul 12 17:28:41.241545 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:41.241148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerStarted","Data":"bc069e686dcd5333b4a61fd4c650c38404272f9aac6d636ca1c41b4edee8034f"}
Jul 12 17:28:41.271390 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:41.271334    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podStartSLOduration=2.271319666 podStartE2EDuration="2.271319666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:28:41.268639017 +0000 UTC m=+1569.470472273" watchObservedRunningTime="2026-07-12 17:28:41.271319666 +0000 UTC m=+1569.473152922"
Jul 12 17:28:42.207401 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:42.207358    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:42.212230 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:42.212206    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:42.246233 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:42.246198    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:42.247151 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:42.247132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:53.305117 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.305078    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerID="ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880" exitCode=0
Jul 12 17:28:53.305554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.305152    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerDied","Data":"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"}
Jul 12 17:28:53.305554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.305533    2584 scope.go:117] "RemoveContainer" containerID="ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"
Jul 12 17:28:53.306609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.306582    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:53.306680 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.306662    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:53.306730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:53.306715    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 17:28:54.312702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:54.312666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerStarted","Data":"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"}
Jul 12 17:28:55.207839 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:55.207793    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:55.208953 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:55.208930    2584 patch_prober.go:28] interesting pod/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 12 17:28:55.209019 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:55.208978    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 12 17:28:56.207596 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:56.207551    2584 patch_prober.go:28] interesting pod/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 12 17:28:56.208055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:56.207621    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 12 17:28:57.207858 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:57.207820    2584 patch_prober.go:28] interesting pod/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 12 17:28:57.208295 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:57.207886    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 12 17:28:57.246598 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:57.246549    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:58.211284 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:58.211250    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:28:58.212183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:28:58.212163    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:29:12.723189 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:12.723148    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:29:12.723736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:12.723420    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy" containerID="cri-o://378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532" gracePeriod=30
Jul 12 17:29:13.214289 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:13.214247    2584 patch_prober.go:28] interesting pod/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 12 17:29:13.214462 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:13.214303    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 17:29:17.978283 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:17.978257    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:29:18.004327 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004233    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004566 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004528    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004705 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004623    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004705 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004653    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004705 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004682    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004711    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004803    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swnk9\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004826    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.004919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.004864    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy\") pod \"6d246e87-1ea1-4b5f-8610-255a2abc9287\" (UID: \"6d246e87-1ea1-4b5f-8610-255a2abc9287\") "
Jul 12 17:29:18.006148 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.005689    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:29:18.006148 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.005842    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:29:18.006148 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.006063    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:29:18.006148 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.006105    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:29:18.007362 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.007336    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:29:18.008323 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.008260    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:29:18.008428 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.008334    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 17:29:18.008753 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.008729    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:29:18.009303 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.009282    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9" (OuterVolumeSpecName: "kube-api-access-swnk9") pod "6d246e87-1ea1-4b5f-8610-255a2abc9287" (UID: "6d246e87-1ea1-4b5f-8610-255a2abc9287"). InnerVolumeSpecName "kube-api-access-swnk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:29:18.106546 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106506    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swnk9\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-kube-api-access-swnk9\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106546 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106539    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-data\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106555    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-envoy\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106566    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-podinfo\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106577    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d246e87-1ea1-4b5f-8610-255a2abc9287-istio-token\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106588    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106601    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d246e87-1ea1-4b5f-8610-255a2abc9287-istiod-ca-cert\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106612    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-workload-certs\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.106747 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.106622    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d246e87-1ea1-4b5f-8610-255a2abc9287-credential-socket\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:18.437554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.437510    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerID="378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532" exitCode=0
Jul 12 17:29:18.437711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.437559    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"
Jul 12 17:29:18.437711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.437574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerDied","Data":"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"}
Jul 12 17:29:18.437711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.437629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j" event={"ID":"6d246e87-1ea1-4b5f-8610-255a2abc9287","Type":"ContainerDied","Data":"bc069e686dcd5333b4a61fd4c650c38404272f9aac6d636ca1c41b4edee8034f"}
Jul 12 17:29:18.437711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.437661    2584 scope.go:117] "RemoveContainer" containerID="378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"
Jul 12 17:29:18.446628 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.446607    2584 scope.go:117] "RemoveContainer" containerID="ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"
Jul 12 17:29:18.455241 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.455220    2584 scope.go:117] "RemoveContainer" containerID="378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"
Jul 12 17:29:18.455522 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:29:18.455498    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532\": container with ID starting with 378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532 not found: ID does not exist" containerID="378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"
Jul 12 17:29:18.455611 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.455530    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532"} err="failed to get container status \"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532\": rpc error: code = NotFound desc = could not find container \"378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532\": container with ID starting with 378a58b3f2bf7be75cc233861044e385b8785cf627bde38cc0ccc71db04f3532 not found: ID does not exist"
Jul 12 17:29:18.455611 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.455552    2584 scope.go:117] "RemoveContainer" containerID="ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"
Jul 12 17:29:18.455822 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:29:18.455799    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880\": container with ID starting with ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880 not found: ID does not exist" containerID="ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"
Jul 12 17:29:18.455871 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.455831    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880"} err="failed to get container status \"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880\": rpc error: code = NotFound desc = could not find container \"ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880\": container with ID starting with ce68770eb5f65a3e2bab84333bd5414284cbe9971f422cca0e4a65a01d85e880 not found: ID does not exist"
Jul 12 17:29:18.456073 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.456033    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:29:18.459097 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.459075    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-187a6623-openshift-default-598bb4b59-2r94j"]
Jul 12 17:29:18.605845 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.605804    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:18.606222 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606204    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.606314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606225    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.606314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606241    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:29:18.606314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606249    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25292c0a-a342-4e83-826f-d3f9b531f164" containerName="istio-proxy"
Jul 12 17:29:18.606314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606275    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.606314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606284    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.606549 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606385    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.606549 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.606395    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" containerName="istio-proxy"
Jul 12 17:29:18.611012 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.610989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:18.614038 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.614005    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:29:18.614167 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.614051    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:29:18.616052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.616028    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:18.711443 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.711341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk\" (UID: \"497c8842-ea97-477e-93ee-54c848a16b22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:18.812088 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.812056    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk\" (UID: \"497c8842-ea97-477e-93ee-54c848a16b22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:18.812718 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.812698    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk\" (UID: \"497c8842-ea97-477e-93ee-54c848a16b22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:18.922332 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:18.922300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:19.052415 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:19.052383    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:19.054391 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:29:19.054367    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497c8842_ea97_477e_93ee_54c848a16b22.slice/crio-5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307 WatchSource:0}: Error finding container 5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307: Status 404 returned error can't find the container with id 5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307
Jul 12 17:29:19.056349 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:19.056328    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 17:29:19.444412 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:19.444375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" event={"ID":"497c8842-ea97-477e-93ee-54c848a16b22","Type":"ContainerStarted","Data":"5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307"}
Jul 12 17:29:20.381397 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:20.381365    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d246e87-1ea1-4b5f-8610-255a2abc9287" path="/var/lib/kubelet/pods/6d246e87-1ea1-4b5f-8610-255a2abc9287/volumes"
Jul 12 17:29:22.464700 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:22.464658    2584 generic.go:356] "Generic (PLEG): container finished" podID="497c8842-ea97-477e-93ee-54c848a16b22" containerID="e197115b9ee254a41af642e4ff098ae5e5a74efac75b4a8d64601cf983b9f147" exitCode=7
Jul 12 17:29:22.465118 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:22.464755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" event={"ID":"497c8842-ea97-477e-93ee-54c848a16b22","Type":"ContainerDied","Data":"e197115b9ee254a41af642e4ff098ae5e5a74efac75b4a8d64601cf983b9f147"}
Jul 12 17:29:22.465118 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:22.464955    2584 scope.go:117] "RemoveContainer" containerID="e197115b9ee254a41af642e4ff098ae5e5a74efac75b4a8d64601cf983b9f147"
Jul 12 17:29:23.471440 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:23.471347    2584 generic.go:356] "Generic (PLEG): container finished" podID="497c8842-ea97-477e-93ee-54c848a16b22" containerID="7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb" exitCode=7
Jul 12 17:29:23.471819 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:23.471438    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" event={"ID":"497c8842-ea97-477e-93ee-54c848a16b22","Type":"ContainerDied","Data":"7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb"}
Jul 12 17:29:23.471819 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:23.471493    2584 scope.go:117] "RemoveContainer" containerID="e197115b9ee254a41af642e4ff098ae5e5a74efac75b4a8d64601cf983b9f147"
Jul 12 17:29:23.471819 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:23.471645    2584 scope.go:117] "RemoveContainer" containerID="7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb"
Jul 12 17:29:23.471955 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:29:23.471893    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk_odh-ai-gateway-infra(497c8842-ea97-477e-93ee-54c848a16b22)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" podUID="497c8842-ea97-477e-93ee-54c848a16b22"
Jul 12 17:29:24.478447 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:24.478377    2584 scope.go:117] "RemoveContainer" containerID="7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb"
Jul 12 17:29:24.478834 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:29:24.478545    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk_odh-ai-gateway-infra(497c8842-ea97-477e-93ee-54c848a16b22)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" podUID="497c8842-ea97-477e-93ee-54c848a16b22"
Jul 12 17:29:38.373494 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:38.373452    2584 scope.go:117] "RemoveContainer" containerID="7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb"
Jul 12 17:29:39.555640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:39.555607    2584 generic.go:356] "Generic (PLEG): container finished" podID="497c8842-ea97-477e-93ee-54c848a16b22" containerID="f3b262f73ff7fcfafded22e89442a7ced0ab9e8aeb31306904f88e5c59054ff2" exitCode=0
Jul 12 17:29:39.556089 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:39.555656    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" event={"ID":"497c8842-ea97-477e-93ee-54c848a16b22","Type":"ContainerDied","Data":"f3b262f73ff7fcfafded22e89442a7ced0ab9e8aeb31306904f88e5c59054ff2"}
Jul 12 17:29:39.556089 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:39.555703    2584 scope.go:117] "RemoveContainer" containerID="7e45277da48646faebdf0c88ff392698c1087dd71635725b54f1caa633cd61cb"
Jul 12 17:29:40.587378 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:40.587331    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:40.695840 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:40.695815    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:40.826014 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:40.825927    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca\") pod \"497c8842-ea97-477e-93ee-54c848a16b22\" (UID: \"497c8842-ea97-477e-93ee-54c848a16b22\") "
Jul 12 17:29:40.826314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:40.826290    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "497c8842-ea97-477e-93ee-54c848a16b22" (UID: "497c8842-ea97-477e-93ee-54c848a16b22"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:29:40.927351 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:40.927315    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8842-ea97-477e-93ee-54c848a16b22-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:29:41.568628 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:41.568598    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"
Jul 12 17:29:41.568908 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:41.568628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk" event={"ID":"497c8842-ea97-477e-93ee-54c848a16b22","Type":"ContainerDied","Data":"5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307"}
Jul 12 17:29:41.568908 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:41.568673    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5035f80abb6dc3ca5734d194bb44eed5e18b9385f255501b12a0de20d576f307"
Jul 12 17:29:41.596813 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:41.596778    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:41.601796 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:41.601755    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-l5xbk"]
Jul 12 17:29:42.379097 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:29:42.379060    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497c8842-ea97-477e-93ee-54c848a16b22" path="/var/lib/kubelet/pods/497c8842-ea97-477e-93ee-54c848a16b22/volumes"
Jul 12 17:30:18.644276 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644241    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"]
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644609    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644621    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644631    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644637    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644697    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.644730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.644705    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:30:18.647858 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.647839    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:18.650341 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.650318    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:30:18.650574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.650318    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:30:18.654486 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.654461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"]
Jul 12 17:30:18.755480 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.755449    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf\" (UID: \"46e3406c-b784-47ab-98aa-7b91f4f020a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:18.856832 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.856805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf\" (UID: \"46e3406c-b784-47ab-98aa-7b91f4f020a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:18.857363 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.857344    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf\" (UID: \"46e3406c-b784-47ab-98aa-7b91f4f020a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:18.959695 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:18.959623    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:19.089159 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:19.089133    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"]
Jul 12 17:30:19.090873 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:30:19.090848    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e3406c_b784_47ab_98aa_7b91f4f020a6.slice/crio-35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34 WatchSource:0}: Error finding container 35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34: Status 404 returned error can't find the container with id 35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34
Jul 12 17:30:19.759698 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:19.759665    2584 generic.go:356] "Generic (PLEG): container finished" podID="46e3406c-b784-47ab-98aa-7b91f4f020a6" containerID="0d0609489799e25fccb5a6c213a67621c0488139ed78e51ffb79659dbeb24ccd" exitCode=0
Jul 12 17:30:19.760070 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:19.759723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf" event={"ID":"46e3406c-b784-47ab-98aa-7b91f4f020a6","Type":"ContainerDied","Data":"0d0609489799e25fccb5a6c213a67621c0488139ed78e51ffb79659dbeb24ccd"}
Jul 12 17:30:19.760070 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:19.759786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf" event={"ID":"46e3406c-b784-47ab-98aa-7b91f4f020a6","Type":"ContainerStarted","Data":"35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34"}
Jul 12 17:30:20.898152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:20.898127    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:20.974689 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:20.974662    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca\") pod \"46e3406c-b784-47ab-98aa-7b91f4f020a6\" (UID: \"46e3406c-b784-47ab-98aa-7b91f4f020a6\") "
Jul 12 17:30:20.975041 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:20.975022    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46e3406c-b784-47ab-98aa-7b91f4f020a6" (UID: "46e3406c-b784-47ab-98aa-7b91f4f020a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:30:21.075509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:21.075435    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e3406c-b784-47ab-98aa-7b91f4f020a6-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:30:21.770699 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:21.770665    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf"
Jul 12 17:30:21.770895 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:21.770696    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf" event={"ID":"46e3406c-b784-47ab-98aa-7b91f4f020a6","Type":"ContainerDied","Data":"35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34"}
Jul 12 17:30:21.770895 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:30:21.770807    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35d324cdf4fac459f423fc7fdd93485382df3f29e454d17f312e43507bc1ce34"
Jul 12 17:32:23.403203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403165    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:23.403738 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403713    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e3406c-b784-47ab-98aa-7b91f4f020a6" containerName="revoke-keys"
Jul 12 17:32:23.403738 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403730    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e3406c-b784-47ab-98aa-7b91f4f020a6" containerName="revoke-keys"
Jul 12 17:32:23.403883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403777    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:32:23.403883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403787    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:32:23.403883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403879    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="497c8842-ea97-477e-93ee-54c848a16b22" containerName="revoke-keys"
Jul 12 17:32:23.404028 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.403890    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e3406c-b784-47ab-98aa-7b91f4f020a6" containerName="revoke-keys"
Jul 12 17:32:23.407336 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.407317    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.410013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.409991    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:32:23.410013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.410002    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-24c431b4-serving-cert\""
Jul 12 17:32:23.410013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.410007    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 17:32:23.411173 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.411156    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bljs8\""
Jul 12 17:32:23.418465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.418438    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:23.441836 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.441793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mww7\" (UniqueName: \"kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.441999 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.441850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.441999 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.441930    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.543310 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.543272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.543492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.543338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mww7\" (UniqueName: \"kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.543492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.543360    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.543568 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:32:23.543511    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-serving-cert: secret "maas-api-e2e-mt-24c431b4-serving-cert" not found
Jul 12 17:32:23.543602 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:32:23.543593    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls podName:2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77 nodeName:}" failed. No retries permitted until 2026-07-12 17:32:24.043573614 +0000 UTC m=+1792.245406859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls") pod "maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" (UID: "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77") : secret "maas-api-e2e-mt-24c431b4-serving-cert" not found
Jul 12 17:32:23.544164 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.544142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:23.553518 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:23.553488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mww7\" (UniqueName: \"kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:24.047980 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:24.047937    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:24.050406 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:24.050381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") pod \"maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:24.321205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:24.321092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:24.460406 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:24.460376    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:24.462452 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:32:24.462426    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2905f1e4_53f3_4b7e_a7e2_42f42b4e1b77.slice/crio-c3729d9a4f69e659ca6fd0a108cbe89a4b9a6e7b85996bad56fc6575a5b2c81d WatchSource:0}: Error finding container c3729d9a4f69e659ca6fd0a108cbe89a4b9a6e7b85996bad56fc6575a5b2c81d: Status 404 returned error can't find the container with id c3729d9a4f69e659ca6fd0a108cbe89a4b9a6e7b85996bad56fc6575a5b2c81d
Jul 12 17:32:25.408968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:25.408919    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" event={"ID":"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77","Type":"ContainerStarted","Data":"c3729d9a4f69e659ca6fd0a108cbe89a4b9a6e7b85996bad56fc6575a5b2c81d"}
Jul 12 17:32:26.415706 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:26.415662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" event={"ID":"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77","Type":"ContainerStarted","Data":"64d6b59acc1a1d3045e956f1aeff626e3868e50ff3ab7e6df1779756ebcdb0b0"}
Jul 12 17:32:26.416126 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:26.415826    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:26.432216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:26.432121    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" podStartSLOduration=1.7273526609999998 podStartE2EDuration="3.43210617s" totalImagesPullingTime="1.704753509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:32:26.430813288 +0000 UTC m=+1794.632646547" watchObservedRunningTime="2026-07-12 17:32:26.43210617 +0000 UTC m=+1794.633939426"
Jul 12 17:32:32.427883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:32.427853    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:32.536240 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:32.536206    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:32:32.536513 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:32.536496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:32:35.116034 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.115997    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"]
Jul 12 17:32:35.119078 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.119061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:35.121722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.121699    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:32:35.126826 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.126796    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"]
Jul 12 17:32:35.148055 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.148017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-24c431b4-dhm69\" (UID: \"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:35.249155 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.249116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-24c431b4-dhm69\" (UID: \"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:35.249750 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.249728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-24c431b4-dhm69\" (UID: \"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:35.431032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.430925    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:35.771152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:35.771120    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"]
Jul 12 17:32:35.773360 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:32:35.773333    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67336b0_eb0e_4bb4_8d97_b55149a3c0ee.slice/crio-b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0 WatchSource:0}: Error finding container b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0: Status 404 returned error can't find the container with id b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0
Jul 12 17:32:36.471405 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:36.471377    2584 generic.go:356] "Generic (PLEG): container finished" podID="a67336b0-eb0e-4bb4-8d97-b55149a3c0ee" containerID="914d390ab2c891a84247040bb7c2caee590902d9b249b99980b403d0e2c9fceb" exitCode=0
Jul 12 17:32:36.471806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:36.471458    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69" event={"ID":"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee","Type":"ContainerDied","Data":"914d390ab2c891a84247040bb7c2caee590902d9b249b99980b403d0e2c9fceb"}
Jul 12 17:32:36.471806 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:36.471514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69" event={"ID":"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee","Type":"ContainerStarted","Data":"b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0"}
Jul 12 17:32:37.611702 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:37.611679    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:37.672524 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:37.672491    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca\") pod \"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee\" (UID: \"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee\") "
Jul 12 17:32:37.672825 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:37.672801    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a67336b0-eb0e-4bb4-8d97-b55149a3c0ee" (UID: "a67336b0-eb0e-4bb4-8d97-b55149a3c0ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:32:37.773711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:37.773620    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a67336b0-eb0e-4bb4-8d97-b55149a3c0ee-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:32:38.484733 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:38.484702    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69"
Jul 12 17:32:38.484950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:38.484700    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-24c431b4-dhm69" event={"ID":"a67336b0-eb0e-4bb4-8d97-b55149a3c0ee","Type":"ContainerDied","Data":"b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0"}
Jul 12 17:32:38.484950 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:38.484802    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b36040e02969a4ab81f86960c7c524dcf8b80b0bfd05f62c05d20965a88cd9b0"
Jul 12 17:32:45.320368 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.320324    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:45.320873 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.320543    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" podUID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" containerName="maas-api" containerID="cri-o://64d6b59acc1a1d3045e956f1aeff626e3868e50ff3ab7e6df1779756ebcdb0b0" gracePeriod=30
Jul 12 17:32:45.524052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.524016    2584 generic.go:356] "Generic (PLEG): container finished" podID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" containerID="64d6b59acc1a1d3045e956f1aeff626e3868e50ff3ab7e6df1779756ebcdb0b0" exitCode=0
Jul 12 17:32:45.524212 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.524089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" event={"ID":"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77","Type":"ContainerDied","Data":"64d6b59acc1a1d3045e956f1aeff626e3868e50ff3ab7e6df1779756ebcdb0b0"}
Jul 12 17:32:45.578818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.578739    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:45.647722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.647678    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca\") pod \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") "
Jul 12 17:32:45.647920 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.647745    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mww7\" (UniqueName: \"kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7\") pod \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") "
Jul 12 17:32:45.647920 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.647808    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") pod \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\" (UID: \"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77\") "
Jul 12 17:32:45.648179 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.648152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" (UID: "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:32:45.650065 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.650041    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" (UID: "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:32:45.650145 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.650063    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7" (OuterVolumeSpecName: "kube-api-access-8mww7") pod "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" (UID: "2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77"). InnerVolumeSpecName "kube-api-access-8mww7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:32:45.749347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.749310    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:32:45.749347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.749342    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mww7\" (UniqueName: \"kubernetes.io/projected/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-kube-api-access-8mww7\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:32:45.749347 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:45.749354    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:32:46.530930 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:46.530899    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"
Jul 12 17:32:46.531327 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:46.530929    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4" event={"ID":"2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77","Type":"ContainerDied","Data":"c3729d9a4f69e659ca6fd0a108cbe89a4b9a6e7b85996bad56fc6575a5b2c81d"}
Jul 12 17:32:46.531327 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:46.530995    2584 scope.go:117] "RemoveContainer" containerID="64d6b59acc1a1d3045e956f1aeff626e3868e50ff3ab7e6df1779756ebcdb0b0"
Jul 12 17:32:46.548544 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:46.548519    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:46.554153 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:46.554132    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24c431b4-7866c94fc4-j5dh4"]
Jul 12 17:32:48.379125 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:32:48.379083    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" path="/var/lib/kubelet/pods/2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77/volumes"
Jul 12 17:33:23.732018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.731903    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732438    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a67336b0-eb0e-4bb4-8d97-b55149a3c0ee" containerName="revoke-keys"
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732454    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a67336b0-eb0e-4bb4-8d97-b55149a3c0ee" containerName="revoke-keys"
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732470    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" containerName="maas-api"
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732476    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" containerName="maas-api"
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732530    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2905f1e4-53f3-4b7e-a7e2-42f42b4e1b77" containerName="maas-api"
Jul 12 17:33:23.732617 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.732538    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a67336b0-eb0e-4bb4-8d97-b55149a3c0ee" containerName="revoke-keys"
Jul 12 17:33:23.735910 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.735889    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.738548 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.738521    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d91d15cb-serving-cert\""
Jul 12 17:33:23.738673 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.738533    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 17:33:23.738673 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.738559    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:33:23.739572 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.739555    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bljs8\""
Jul 12 17:33:23.748722 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.748701    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:33:23.775576 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.775540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.775749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.775613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb97n\" (UniqueName: \"kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.775749 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.775651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.877005 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.876965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb97n\" (UniqueName: \"kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.877182 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.877017    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.877182 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.877044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.877264 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:33:23.877186    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-serving-cert: secret "maas-api-e2e-mt-d91d15cb-serving-cert" not found
Jul 12 17:33:23.877264 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:33:23.877245    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls podName:4e8d20e6-f4f2-43d7-be36-aaed6b800e86 nodeName:}" failed. No retries permitted until 2026-07-12 17:33:24.37722956 +0000 UTC m=+1852.579062796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls") pod "maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" (UID: "4e8d20e6-f4f2-43d7-be36-aaed6b800e86") : secret "maas-api-e2e-mt-d91d15cb-serving-cert" not found
Jul 12 17:33:23.877643 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.877626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:23.885837 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:23.885809    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb97n\" (UniqueName: \"kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:24.381462 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:24.381425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:24.383837 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:24.383810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") pod \"maas-api-e2e-mt-d91d15cb-546598b844-qn8t5\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:24.649465 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:24.649371    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:24.783158 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:24.783129    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:33:24.784285 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:33:24.784257    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8d20e6_f4f2_43d7_be36_aaed6b800e86.slice/crio-72856d95da02309a992380251a92cbd773c0d571da091fbdcb14edf7c77f5054 WatchSource:0}: Error finding container 72856d95da02309a992380251a92cbd773c0d571da091fbdcb14edf7c77f5054: Status 404 returned error can't find the container with id 72856d95da02309a992380251a92cbd773c0d571da091fbdcb14edf7c77f5054
Jul 12 17:33:25.741344 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:25.741306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" event={"ID":"4e8d20e6-f4f2-43d7-be36-aaed6b800e86","Type":"ContainerStarted","Data":"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"}
Jul 12 17:33:25.741541 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:25.741389    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:33:25.741541 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:25.741406    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" event={"ID":"4e8d20e6-f4f2-43d7-be36-aaed6b800e86","Type":"ContainerStarted","Data":"72856d95da02309a992380251a92cbd773c0d571da091fbdcb14edf7c77f5054"}
Jul 12 17:33:25.759499 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:25.759449    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" podStartSLOduration=2.3880408859999998 podStartE2EDuration="2.759434642s" totalImagesPullingTime="371.393756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:33:25.758597475 +0000 UTC m=+1853.960430748" watchObservedRunningTime="2026-07-12 17:33:25.759434642 +0000 UTC m=+1853.961267898"
Jul 12 17:33:31.752024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:33:31.751993    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:36:32.576216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:36:32.576184    2584 scope.go:117] "RemoveContainer" containerID="f3b262f73ff7fcfafded22e89442a7ced0ab9e8aeb31306904f88e5c59054ff2"
Jul 12 17:37:10.786459 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:10.786375    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"]
Jul 12 17:37:10.789880 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:10.789863    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:10.792189 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:10.792169    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:37:10.803741 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:10.803718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"]
Jul 12 17:37:10.914094 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:10.914055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj\" (UID: \"78f76d6a-9267-4629-9143-180b1df34400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:11.015077 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.015038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj\" (UID: \"78f76d6a-9267-4629-9143-180b1df34400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:11.015659 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.015638    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj\" (UID: \"78f76d6a-9267-4629-9143-180b1df34400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:11.100261 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.100178    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:11.230124 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.230097    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"]
Jul 12 17:37:11.232291 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:37:11.232263    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f76d6a_9267_4629_9143_180b1df34400.slice/crio-e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7 WatchSource:0}: Error finding container e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7: Status 404 returned error can't find the container with id e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7
Jul 12 17:37:11.896520 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.896484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj" event={"ID":"78f76d6a-9267-4629-9143-180b1df34400","Type":"ContainerStarted","Data":"316f09c203962b5765c06266053acf626a0c771f4308b29f0c19edd70974f3ae"}
Jul 12 17:37:11.896918 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.896540    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj" event={"ID":"78f76d6a-9267-4629-9143-180b1df34400","Type":"ContainerStarted","Data":"e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7"}
Jul 12 17:37:11.912786 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:11.912708    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj" podStartSLOduration=1.912688317 podStartE2EDuration="1.912688317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:37:11.91217421 +0000 UTC m=+2080.114007467" watchObservedRunningTime="2026-07-12 17:37:11.912688317 +0000 UTC m=+2080.114521575"
Jul 12 17:37:12.903159 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:12.903125    2584 generic.go:356] "Generic (PLEG): container finished" podID="78f76d6a-9267-4629-9143-180b1df34400" containerID="316f09c203962b5765c06266053acf626a0c771f4308b29f0c19edd70974f3ae" exitCode=0
Jul 12 17:37:12.903561 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:12.903213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj" event={"ID":"78f76d6a-9267-4629-9143-180b1df34400","Type":"ContainerDied","Data":"316f09c203962b5765c06266053acf626a0c771f4308b29f0c19edd70974f3ae"}
Jul 12 17:37:14.040113 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.040090    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:14.041108 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.041090    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca\") pod \"78f76d6a-9267-4629-9143-180b1df34400\" (UID: \"78f76d6a-9267-4629-9143-180b1df34400\") "
Jul 12 17:37:14.041444 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.041424    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78f76d6a-9267-4629-9143-180b1df34400" (UID: "78f76d6a-9267-4629-9143-180b1df34400"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:37:14.142346 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.142315    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78f76d6a-9267-4629-9143-180b1df34400-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:37:14.920314 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.920280    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj"
Jul 12 17:37:14.920508 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.920299    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj" event={"ID":"78f76d6a-9267-4629-9143-180b1df34400","Type":"ContainerDied","Data":"e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7"}
Jul 12 17:37:14.920508 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:14.920394    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3208d67cf7fb1c86928cfdc1350e413804f3d895f31b3fde297e6868f7a20d7"
Jul 12 17:37:21.160113 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.160068    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:37:21.160657 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.160385    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" podUID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" containerName="maas-api" containerID="cri-o://7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16" gracePeriod=30
Jul 12 17:37:21.410973 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.410908    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:37:21.502945 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.502911    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb97n\" (UniqueName: \"kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n\") pod \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") "
Jul 12 17:37:21.503143 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.502961    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca\") pod \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") "
Jul 12 17:37:21.503143 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.502983    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") pod \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\" (UID: \"4e8d20e6-f4f2-43d7-be36-aaed6b800e86\") "
Jul 12 17:37:21.503332 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.503304    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e8d20e6-f4f2-43d7-be36-aaed6b800e86" (UID: "4e8d20e6-f4f2-43d7-be36-aaed6b800e86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:37:21.505087 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.505064    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e8d20e6-f4f2-43d7-be36-aaed6b800e86" (UID: "4e8d20e6-f4f2-43d7-be36-aaed6b800e86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:37:21.505187 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.505160    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n" (OuterVolumeSpecName: "kube-api-access-xb97n") pod "4e8d20e6-f4f2-43d7-be36-aaed6b800e86" (UID: "4e8d20e6-f4f2-43d7-be36-aaed6b800e86"). InnerVolumeSpecName "kube-api-access-xb97n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:37:21.603968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.603933    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb97n\" (UniqueName: \"kubernetes.io/projected/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-kube-api-access-xb97n\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:37:21.603968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.603958    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:37:21.603968 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.603968    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8d20e6-f4f2-43d7-be36-aaed6b800e86-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:37:21.956623 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.956585    2584 generic.go:356] "Generic (PLEG): container finished" podID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" containerID="7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16" exitCode=0
Jul 12 17:37:21.956818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.956637    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"
Jul 12 17:37:21.956818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.956678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" event={"ID":"4e8d20e6-f4f2-43d7-be36-aaed6b800e86","Type":"ContainerDied","Data":"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"}
Jul 12 17:37:21.956818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.956728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5" event={"ID":"4e8d20e6-f4f2-43d7-be36-aaed6b800e86","Type":"ContainerDied","Data":"72856d95da02309a992380251a92cbd773c0d571da091fbdcb14edf7c77f5054"}
Jul 12 17:37:21.956818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.956752    2584 scope.go:117] "RemoveContainer" containerID="7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"
Jul 12 17:37:21.966303 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.966285    2584 scope.go:117] "RemoveContainer" containerID="7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"
Jul 12 17:37:21.966585 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:37:21.966566    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16\": container with ID starting with 7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16 not found: ID does not exist" containerID="7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"
Jul 12 17:37:21.966644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.966593    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16"} err="failed to get container status \"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16\": rpc error: code = NotFound desc = could not find container \"7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16\": container with ID starting with 7b308d2d783f04a9c0d7112c9595239e8b0da9e7875b168b3e78ebf881a92b16 not found: ID does not exist"
Jul 12 17:37:21.979011 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.978980    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:37:21.986060 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:21.986036    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d91d15cb-546598b844-qn8t5"]
Jul 12 17:37:22.380428 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:22.380394    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" path="/var/lib/kubelet/pods/4e8d20e6-f4f2-43d7-be36-aaed6b800e86/volumes"
Jul 12 17:37:32.576305 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:32.576279    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:37:32.578557 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:37:32.578537    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:39:14.888213 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888180    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888544    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f76d6a-9267-4629-9143-180b1df34400" containerName="revoke-keys"
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888555    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f76d6a-9267-4629-9143-180b1df34400" containerName="revoke-keys"
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888567    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" containerName="maas-api"
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888573    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" containerName="maas-api"
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888636    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8d20e6-f4f2-43d7-be36-aaed6b800e86" containerName="maas-api"
Jul 12 17:39:14.890736 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.888647    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f76d6a-9267-4629-9143-180b1df34400" containerName="revoke-keys"
Jul 12 17:39:14.891694 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.891674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:14.894203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.894177    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 17:39:14.894321 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.894287    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:39:14.894443 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.894425    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bljs8\""
Jul 12 17:39:14.895343 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.895327    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c5fd66-serving-cert\""
Jul 12 17:39:14.901019 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:14.900998    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:39:15.023553 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.023510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.023752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.023574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.023752 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.023644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvz9\" (UniqueName: \"kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.124812 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.124771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.125007 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.124828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.125007 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.124879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvz9\" (UniqueName: \"kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.125007 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:39:15.124972    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-serving-cert: secret "maas-api-e2e-inf-a-c5fd66-serving-cert" not found
Jul 12 17:39:15.125186 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:39:15.125049    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls podName:0d9a5912-b439-400f-a9cc-933df7a4b365 nodeName:}" failed. No retries permitted until 2026-07-12 17:39:15.625032668 +0000 UTC m=+2203.826865903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls") pod "maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" (UID: "0d9a5912-b439-400f-a9cc-933df7a4b365") : secret "maas-api-e2e-inf-a-c5fd66-serving-cert" not found
Jul 12 17:39:15.125515 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.125491    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.135700 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.135667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvz9\" (UniqueName: \"kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.630373 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.630335    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.632852 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.632821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") pod \"maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.803367 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.803334    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:15.932318 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.932292    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:39:15.934599 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:39:15.934573    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9a5912_b439_400f_a9cc_933df7a4b365.slice/crio-dd29052bfbb5d5042874565421978071cfddff5282353b1f8a472cca3f9c5422 WatchSource:0}: Error finding container dd29052bfbb5d5042874565421978071cfddff5282353b1f8a472cca3f9c5422: Status 404 returned error can't find the container with id dd29052bfbb5d5042874565421978071cfddff5282353b1f8a472cca3f9c5422
Jul 12 17:39:15.935948 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:15.935931    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 17:39:16.556886 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:16.556846    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" event={"ID":"0d9a5912-b439-400f-a9cc-933df7a4b365","Type":"ContainerStarted","Data":"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"}
Jul 12 17:39:16.557132 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:16.556913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" event={"ID":"0d9a5912-b439-400f-a9cc-933df7a4b365","Type":"ContainerStarted","Data":"dd29052bfbb5d5042874565421978071cfddff5282353b1f8a472cca3f9c5422"}
Jul 12 17:39:16.557132 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:16.557033    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:16.577399 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:16.577353    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" podStartSLOduration=2.108344385 podStartE2EDuration="2.57733786s" totalImagesPullingTime="468.993475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:39:16.575707012 +0000 UTC m=+2204.777540312" watchObservedRunningTime="2026-07-12 17:39:16.57733786 +0000 UTC m=+2204.779171117"
Jul 12 17:39:22.569331 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:22.569302    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:39:27.748060 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.748023    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:39:27.751885 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.751867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.754352 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.754331    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7fa4a5-serving-cert\""
Jul 12 17:39:27.761203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.761179    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:39:27.842224 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.842104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kpj\" (UniqueName: \"kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.842224 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.842164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.842522 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.842313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.942864 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.942818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kpj\" (UniqueName: \"kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.942864 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.942861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.943139 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.942919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.943536 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.943506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.945302 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.945279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:27.950660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:27.950636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kpj\" (UniqueName: \"kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj\") pod \"maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:28.064903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:28.064794    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:28.206120 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:28.206090    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:39:28.207379 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:39:28.207356    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460987ec_d410_4c49_b05b_1f1ec5886c43.slice/crio-6297bdcf4d6e1f52a7d84b3290556d759f4ae58a67928db532e0b0e71aa76f57 WatchSource:0}: Error finding container 6297bdcf4d6e1f52a7d84b3290556d759f4ae58a67928db532e0b0e71aa76f57: Status 404 returned error can't find the container with id 6297bdcf4d6e1f52a7d84b3290556d759f4ae58a67928db532e0b0e71aa76f57
Jul 12 17:39:28.624012 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:28.623979    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" event={"ID":"460987ec-d410-4c49-b05b-1f1ec5886c43","Type":"ContainerStarted","Data":"6297bdcf4d6e1f52a7d84b3290556d759f4ae58a67928db532e0b0e71aa76f57"}
Jul 12 17:39:29.630667 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:29.630624    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" event={"ID":"460987ec-d410-4c49-b05b-1f1ec5886c43","Type":"ContainerStarted","Data":"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"}
Jul 12 17:39:29.631084 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:29.630695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:39:29.647435 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:29.647379    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" podStartSLOduration=2.201412075 podStartE2EDuration="2.647361871s" totalImagesPullingTime="445.949796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:39:29.646632764 +0000 UTC m=+2217.848466025" watchObservedRunningTime="2026-07-12 17:39:29.647361871 +0000 UTC m=+2217.849195188"
Jul 12 17:39:35.642253 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:39:35.642222    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:40:37.632913 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.632871    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"]
Jul 12 17:40:37.641503 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.641313    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:37.643951 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.643919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"]
Jul 12 17:40:37.644088 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.643996    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:40:37.644688 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.644666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4\" (UID: \"30554806-a17e-4ea1-8fac-66e759e4a5d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:37.745609 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.745570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4\" (UID: \"30554806-a17e-4ea1-8fac-66e759e4a5d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:37.746250 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.746228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4\" (UID: \"30554806-a17e-4ea1-8fac-66e759e4a5d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:37.952389 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:37.952286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:38.094507 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:38.094479    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"]
Jul 12 17:40:38.095393 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:40:38.095372    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30554806_a17e_4ea1_8fac_66e759e4a5d4.slice/crio-70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1 WatchSource:0}: Error finding container 70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1: Status 404 returned error can't find the container with id 70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1
Jul 12 17:40:38.993774 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:38.993728    2584 generic.go:356] "Generic (PLEG): container finished" podID="30554806-a17e-4ea1-8fac-66e759e4a5d4" containerID="f04a9f996508830c6015d75cf5e94b011a0ee466324f4803f6c275b5007a4548" exitCode=0
Jul 12 17:40:38.994174 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:38.993787    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4" event={"ID":"30554806-a17e-4ea1-8fac-66e759e4a5d4","Type":"ContainerDied","Data":"f04a9f996508830c6015d75cf5e94b011a0ee466324f4803f6c275b5007a4548"}
Jul 12 17:40:38.994174 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:38.993830    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4" event={"ID":"30554806-a17e-4ea1-8fac-66e759e4a5d4","Type":"ContainerStarted","Data":"70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1"}
Jul 12 17:40:40.128652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:40.128626    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:40.165853 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:40.165820    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca\") pod \"30554806-a17e-4ea1-8fac-66e759e4a5d4\" (UID: \"30554806-a17e-4ea1-8fac-66e759e4a5d4\") "
Jul 12 17:40:40.166209 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:40.166190    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30554806-a17e-4ea1-8fac-66e759e4a5d4" (UID: "30554806-a17e-4ea1-8fac-66e759e4a5d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:40:40.267268 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:40.267179    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30554806-a17e-4ea1-8fac-66e759e4a5d4-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:40:41.004810 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:41.004754    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4"
Jul 12 17:40:41.004810 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:41.004800    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4" event={"ID":"30554806-a17e-4ea1-8fac-66e759e4a5d4","Type":"ContainerDied","Data":"70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1"}
Jul 12 17:40:41.005083 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:41.004857    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70949de5405dbb95d23972c670e82ecfaf670e6718df6e974640539ac5049ba1"
Jul 12 17:40:47.978979 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:47.978944    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:40:47.979421 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:47.979190    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" podUID="0d9a5912-b439-400f-a9cc-933df7a4b365" containerName="maas-api" containerID="cri-o://7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3" gracePeriod=30
Jul 12 17:40:48.233174 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.233111    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:40:48.342709 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.342678    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bvz9\" (UniqueName: \"kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9\") pod \"0d9a5912-b439-400f-a9cc-933df7a4b365\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") "
Jul 12 17:40:48.342868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.342724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") pod \"0d9a5912-b439-400f-a9cc-933df7a4b365\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") "
Jul 12 17:40:48.342868 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.342785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca\") pod \"0d9a5912-b439-400f-a9cc-933df7a4b365\" (UID: \"0d9a5912-b439-400f-a9cc-933df7a4b365\") "
Jul 12 17:40:48.343219 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.343189    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d9a5912-b439-400f-a9cc-933df7a4b365" (UID: "0d9a5912-b439-400f-a9cc-933df7a4b365"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:40:48.344893 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.344866    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d9a5912-b439-400f-a9cc-933df7a4b365" (UID: "0d9a5912-b439-400f-a9cc-933df7a4b365"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:40:48.344996 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.344871    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9" (OuterVolumeSpecName: "kube-api-access-2bvz9") pod "0d9a5912-b439-400f-a9cc-933df7a4b365" (UID: "0d9a5912-b439-400f-a9cc-933df7a4b365"). InnerVolumeSpecName "kube-api-access-2bvz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:40:48.444462 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.444428    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bvz9\" (UniqueName: \"kubernetes.io/projected/0d9a5912-b439-400f-a9cc-933df7a4b365-kube-api-access-2bvz9\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:40:48.444634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.444526    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9a5912-b439-400f-a9cc-933df7a4b365-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:40:48.444634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:48.444537    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9a5912-b439-400f-a9cc-933df7a4b365-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:40:49.048461 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.048424    2584 generic.go:356] "Generic (PLEG): container finished" podID="0d9a5912-b439-400f-a9cc-933df7a4b365" containerID="7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3" exitCode=0
Jul 12 17:40:49.048903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.048478    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" event={"ID":"0d9a5912-b439-400f-a9cc-933df7a4b365","Type":"ContainerDied","Data":"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"}
Jul 12 17:40:49.048903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.048483    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"
Jul 12 17:40:49.048903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.048525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm" event={"ID":"0d9a5912-b439-400f-a9cc-933df7a4b365","Type":"ContainerDied","Data":"dd29052bfbb5d5042874565421978071cfddff5282353b1f8a472cca3f9c5422"}
Jul 12 17:40:49.048903 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.048548    2584 scope.go:117] "RemoveContainer" containerID="7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"
Jul 12 17:40:49.057260 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.057216    2584 scope.go:117] "RemoveContainer" containerID="7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"
Jul 12 17:40:49.057486 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:40:49.057465    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3\": container with ID starting with 7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3 not found: ID does not exist" containerID="7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"
Jul 12 17:40:49.057527 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.057496    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3"} err="failed to get container status \"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3\": rpc error: code = NotFound desc = could not find container \"7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3\": container with ID starting with 7799a0ef17ebb3cb8142927ab2723a8a04c26674a77db9bc370196522c8a97d3 not found: ID does not exist"
Jul 12 17:40:49.065012 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.064986    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:40:49.068363 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:49.068336    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c5fd66-75d8f477c-dkswm"]
Jul 12 17:40:50.379660 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:40:50.379610    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9a5912-b439-400f-a9cc-933df7a4b365" path="/var/lib/kubelet/pods/0d9a5912-b439-400f-a9cc-933df7a4b365/volumes"
Jul 12 17:41:03.759457 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759421    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"]
Jul 12 17:41:03.759870 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759805    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9a5912-b439-400f-a9cc-933df7a4b365" containerName="maas-api"
Jul 12 17:41:03.759870 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759816    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9a5912-b439-400f-a9cc-933df7a4b365" containerName="maas-api"
Jul 12 17:41:03.759870 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759834    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30554806-a17e-4ea1-8fac-66e759e4a5d4" containerName="revoke-keys"
Jul 12 17:41:03.759870 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759840    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="30554806-a17e-4ea1-8fac-66e759e4a5d4" containerName="revoke-keys"
Jul 12 17:41:03.760013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759895    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9a5912-b439-400f-a9cc-933df7a4b365" containerName="maas-api"
Jul 12 17:41:03.760013 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.759904    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="30554806-a17e-4ea1-8fac-66e759e4a5d4" containerName="revoke-keys"
Jul 12 17:41:03.764286 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.764269    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:03.767096 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.767067    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:41:03.771332 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.771308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"]
Jul 12 17:41:03.882052 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.882015    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb\" (UID: \"460ad528-e65e-4266-9cd7-d0acb1adc132\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:03.982917 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.982870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb\" (UID: \"460ad528-e65e-4266-9cd7-d0acb1adc132\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:03.983516 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:03.983494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb\" (UID: \"460ad528-e65e-4266-9cd7-d0acb1adc132\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:04.075595 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:04.075502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:04.218821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:04.218729    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"]
Jul 12 17:41:04.221078 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:41:04.221051    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460ad528_e65e_4266_9cd7_d0acb1adc132.slice/crio-cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca WatchSource:0}: Error finding container cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca: Status 404 returned error can't find the container with id cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca
Jul 12 17:41:05.137003 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:05.136969    2584 generic.go:356] "Generic (PLEG): container finished" podID="460ad528-e65e-4266-9cd7-d0acb1adc132" containerID="5215b68433dae9d93baacbd4dbf49c2a5bf07773aeda169eab302eef9d6a533f" exitCode=0
Jul 12 17:41:05.137381 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:05.137036    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb" event={"ID":"460ad528-e65e-4266-9cd7-d0acb1adc132","Type":"ContainerDied","Data":"5215b68433dae9d93baacbd4dbf49c2a5bf07773aeda169eab302eef9d6a533f"}
Jul 12 17:41:05.137381 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:05.137073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb" event={"ID":"460ad528-e65e-4266-9cd7-d0acb1adc132","Type":"ContainerStarted","Data":"cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca"}
Jul 12 17:41:06.288938 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:06.288903    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:06.406433 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:06.406346    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca\") pod \"460ad528-e65e-4266-9cd7-d0acb1adc132\" (UID: \"460ad528-e65e-4266-9cd7-d0acb1adc132\") "
Jul 12 17:41:06.406686 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:06.406665    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "460ad528-e65e-4266-9cd7-d0acb1adc132" (UID: "460ad528-e65e-4266-9cd7-d0acb1adc132"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:41:06.507822 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:06.507752    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460ad528-e65e-4266-9cd7-d0acb1adc132-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:41:07.148813 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:07.148777    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb"
Jul 12 17:41:07.148813 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:07.148789    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb" event={"ID":"460ad528-e65e-4266-9cd7-d0acb1adc132","Type":"ContainerDied","Data":"cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca"}
Jul 12 17:41:07.149029 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:07.148837    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf16960fe2cfeb4f0aae8120201e3d71cbf6089e5b8e5ec555849f6c4df029ca"
Jul 12 17:41:14.270915 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:14.270873    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:41:14.272007 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:14.271721    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" podUID="460987ec-d410-4c49-b05b-1f1ec5886c43" containerName="maas-api" containerID="cri-o://54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9" gracePeriod=30
Jul 12 17:41:15.519727 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.519700    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:41:15.692703 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.692668    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls\") pod \"460987ec-d410-4c49-b05b-1f1ec5886c43\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") "
Jul 12 17:41:15.692901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.692811    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6kpj\" (UniqueName: \"kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj\") pod \"460987ec-d410-4c49-b05b-1f1ec5886c43\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") "
Jul 12 17:41:15.692901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.692837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca\") pod \"460987ec-d410-4c49-b05b-1f1ec5886c43\" (UID: \"460987ec-d410-4c49-b05b-1f1ec5886c43\") "
Jul 12 17:41:15.693239 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.693208    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "460987ec-d410-4c49-b05b-1f1ec5886c43" (UID: "460987ec-d410-4c49-b05b-1f1ec5886c43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:41:15.694773 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.694740    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj" (OuterVolumeSpecName: "kube-api-access-j6kpj") pod "460987ec-d410-4c49-b05b-1f1ec5886c43" (UID: "460987ec-d410-4c49-b05b-1f1ec5886c43"). InnerVolumeSpecName "kube-api-access-j6kpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:41:15.694869 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.694845    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "460987ec-d410-4c49-b05b-1f1ec5886c43" (UID: "460987ec-d410-4c49-b05b-1f1ec5886c43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:41:15.794170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.794128    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6kpj\" (UniqueName: \"kubernetes.io/projected/460987ec-d410-4c49-b05b-1f1ec5886c43-kube-api-access-j6kpj\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:41:15.794170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.794163    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460987ec-d410-4c49-b05b-1f1ec5886c43-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:41:15.794170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:15.794173    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460987ec-d410-4c49-b05b-1f1ec5886c43-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:41:16.197959 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.197915    2584 generic.go:356] "Generic (PLEG): container finished" podID="460987ec-d410-4c49-b05b-1f1ec5886c43" containerID="54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9" exitCode=0
Jul 12 17:41:16.197959 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.197954    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"
Jul 12 17:41:16.198183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.197963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" event={"ID":"460987ec-d410-4c49-b05b-1f1ec5886c43","Type":"ContainerDied","Data":"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"}
Jul 12 17:41:16.198183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.198045    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w" event={"ID":"460987ec-d410-4c49-b05b-1f1ec5886c43","Type":"ContainerDied","Data":"6297bdcf4d6e1f52a7d84b3290556d759f4ae58a67928db532e0b0e71aa76f57"}
Jul 12 17:41:16.198183 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.198069    2584 scope.go:117] "RemoveContainer" containerID="54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"
Jul 12 17:41:16.208397 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.208377    2584 scope.go:117] "RemoveContainer" containerID="54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"
Jul 12 17:41:16.208671 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:41:16.208649    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9\": container with ID starting with 54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9 not found: ID does not exist" containerID="54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"
Jul 12 17:41:16.208718 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.208680    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9"} err="failed to get container status \"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9\": rpc error: code = NotFound desc = could not find container \"54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9\": container with ID starting with 54cc76cbce359fe118db00d47d85628e924a05318d564658dbe8171abfeb69d9 not found: ID does not exist"
Jul 12 17:41:16.221308 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.221276    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:41:16.223624 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.223605    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fa4a5-79bb4c759b-5x52w"]
Jul 12 17:41:16.379368 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:16.379337    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460987ec-d410-4c49-b05b-1f1ec5886c43" path="/var/lib/kubelet/pods/460987ec-d410-4c49-b05b-1f1ec5886c43/volumes"
Jul 12 17:41:33.535712 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.535673    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536031    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460987ec-d410-4c49-b05b-1f1ec5886c43" containerName="maas-api"
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536043    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="460987ec-d410-4c49-b05b-1f1ec5886c43" containerName="maas-api"
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536053    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460ad528-e65e-4266-9cd7-d0acb1adc132" containerName="revoke-keys"
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536059    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="460ad528-e65e-4266-9cd7-d0acb1adc132" containerName="revoke-keys"
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536132    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="460987ec-d410-4c49-b05b-1f1ec5886c43" containerName="maas-api"
Jul 12 17:41:33.536203 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.536140    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="460ad528-e65e-4266-9cd7-d0acb1adc132" containerName="revoke-keys"
Jul 12 17:41:33.540689 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.540670    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.544721 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.544701    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bljs8\""
Jul 12 17:41:33.544858 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.544798    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-444d10-serving-cert\""
Jul 12 17:41:33.544858 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.544804    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 17:41:33.544970 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.544906    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:41:33.556987 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.556958    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:41:33.655932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.655901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5xgm\" (UniqueName: \"kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.656116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.655944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.656116 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.655963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.756728 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.756687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5xgm\" (UniqueName: \"kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.756728 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.756733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.756992 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:41:33.756861    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-serving-cert: secret "maas-api-e2e-api-a-444d10-serving-cert" not found
Jul 12 17:41:33.756992 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.756879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.756992 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:41:33.756945    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls podName:82719db1-0aca-4773-9bed-808b9bf8ac48 nodeName:}" failed. No retries permitted until 2026-07-12 17:41:34.256922592 +0000 UTC m=+2342.458755828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls") pod "maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" (UID: "82719db1-0aca-4773-9bed-808b9bf8ac48") : secret "maas-api-e2e-api-a-444d10-serving-cert" not found
Jul 12 17:41:33.757539 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.757518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:33.765448 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:33.765419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5xgm\" (UniqueName: \"kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:34.261413 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:34.261375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:34.263785 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:34.263744    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") pod \"maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:34.450684 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:34.450648    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:34.589914 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:41:34.589881    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82719db1_0aca_4773_9bed_808b9bf8ac48.slice/crio-c1f994a38cc207e3dc15146dcd0f1f8698aee7a80142379c0f25697e9815e2f3 WatchSource:0}: Error finding container c1f994a38cc207e3dc15146dcd0f1f8698aee7a80142379c0f25697e9815e2f3: Status 404 returned error can't find the container with id c1f994a38cc207e3dc15146dcd0f1f8698aee7a80142379c0f25697e9815e2f3
Jul 12 17:41:34.590409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:34.590384    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:41:35.300730 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:35.300694    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" event={"ID":"82719db1-0aca-4773-9bed-808b9bf8ac48","Type":"ContainerStarted","Data":"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"}
Jul 12 17:41:35.300921 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:35.300757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" event={"ID":"82719db1-0aca-4773-9bed-808b9bf8ac48","Type":"ContainerStarted","Data":"c1f994a38cc207e3dc15146dcd0f1f8698aee7a80142379c0f25697e9815e2f3"}
Jul 12 17:41:35.300921 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:35.300896    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:35.320865 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:35.320815    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" podStartSLOduration=1.6871677919999999 podStartE2EDuration="2.320799013s" totalImagesPullingTime="633.631221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:41:35.319304677 +0000 UTC m=+2343.521137934" watchObservedRunningTime="2026-07-12 17:41:35.320799013 +0000 UTC m=+2343.522632271"
Jul 12 17:41:41.312080 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.312046    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:41:41.653966 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.653930    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:41:41.657565 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.657539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.660061 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.660029    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2484ca-serving-cert\""
Jul 12 17:41:41.666050 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.666026    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:41:41.726241 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.726200    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.726241 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.726243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.726506 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.726313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5zm\" (UniqueName: \"kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.827735 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.827699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5zm\" (UniqueName: \"kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.827939 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.827797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.827939 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.827819    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.827939 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:41:41.827933    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-serving-cert: secret "maas-api-e2e-api-b-2484ca-serving-cert" not found
Jul 12 17:41:41.828047 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:41:41.827994    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls podName:1e2d0741-64b2-431e-bcef-10347c39a670 nodeName:}" failed. No retries permitted until 2026-07-12 17:41:42.327977306 +0000 UTC m=+2350.529810546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls") pod "maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" (UID: "1e2d0741-64b2-431e-bcef-10347c39a670") : secret "maas-api-e2e-api-b-2484ca-serving-cert" not found
Jul 12 17:41:41.828637 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.828613    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:41.836481 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:41.836455    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5zm\" (UniqueName: \"kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:42.332101 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:42.332058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:42.334521 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:42.334495    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") pod \"maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:42.572409 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:42.572370    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:42.706426 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:42.706397    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:41:42.707600 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:41:42.707572    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2d0741_64b2_431e_bcef_10347c39a670.slice/crio-f10fa29281ec89153886df8c85f7f9b99be06f2df0a17f559312408e58160e1c WatchSource:0}: Error finding container f10fa29281ec89153886df8c85f7f9b99be06f2df0a17f559312408e58160e1c: Status 404 returned error can't find the container with id f10fa29281ec89153886df8c85f7f9b99be06f2df0a17f559312408e58160e1c
Jul 12 17:41:43.343901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:43.343812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" event={"ID":"1e2d0741-64b2-431e-bcef-10347c39a670","Type":"ContainerStarted","Data":"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"}
Jul 12 17:41:43.343901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:43.343871    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" event={"ID":"1e2d0741-64b2-431e-bcef-10347c39a670","Type":"ContainerStarted","Data":"f10fa29281ec89153886df8c85f7f9b99be06f2df0a17f559312408e58160e1c"}
Jul 12 17:41:43.343901 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:43.343897    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:41:43.361970 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:43.361920    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" podStartSLOduration=2.041945972 podStartE2EDuration="2.36190516s" totalImagesPullingTime="319.959188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:41:43.359960056 +0000 UTC m=+2351.561793315" watchObservedRunningTime="2026-07-12 17:41:43.36190516 +0000 UTC m=+2351.563738452"
Jul 12 17:41:49.353990 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:41:49.353955    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:42:04.870432 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:04.870390    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:42:04.870961 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:04.870642    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" podUID="82719db1-0aca-4773-9bed-808b9bf8ac48" containerName="maas-api" containerID="cri-o://f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1" gracePeriod=30
Jul 12 17:42:05.120108 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.120083    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:42:05.142997 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.142925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") pod \"82719db1-0aca-4773-9bed-808b9bf8ac48\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") "
Jul 12 17:42:05.143133 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.143005    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5xgm\" (UniqueName: \"kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm\") pod \"82719db1-0aca-4773-9bed-808b9bf8ac48\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") "
Jul 12 17:42:05.143133 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.143026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca\") pod \"82719db1-0aca-4773-9bed-808b9bf8ac48\" (UID: \"82719db1-0aca-4773-9bed-808b9bf8ac48\") "
Jul 12 17:42:05.143431 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.143402    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82719db1-0aca-4773-9bed-808b9bf8ac48" (UID: "82719db1-0aca-4773-9bed-808b9bf8ac48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:42:05.145054 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.145026    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82719db1-0aca-4773-9bed-808b9bf8ac48" (UID: "82719db1-0aca-4773-9bed-808b9bf8ac48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:42:05.145226 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.145203    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm" (OuterVolumeSpecName: "kube-api-access-w5xgm") pod "82719db1-0aca-4773-9bed-808b9bf8ac48" (UID: "82719db1-0aca-4773-9bed-808b9bf8ac48"). InnerVolumeSpecName "kube-api-access-w5xgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:42:05.244129 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.244095    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82719db1-0aca-4773-9bed-808b9bf8ac48-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:05.244129 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.244123    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5xgm\" (UniqueName: \"kubernetes.io/projected/82719db1-0aca-4773-9bed-808b9bf8ac48-kube-api-access-w5xgm\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:05.244129 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.244133    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82719db1-0aca-4773-9bed-808b9bf8ac48-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:05.459436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.459347    2584 generic.go:356] "Generic (PLEG): container finished" podID="82719db1-0aca-4773-9bed-808b9bf8ac48" containerID="f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1" exitCode=0
Jul 12 17:42:05.459436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.459390    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"
Jul 12 17:42:05.459436 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.459424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" event={"ID":"82719db1-0aca-4773-9bed-808b9bf8ac48","Type":"ContainerDied","Data":"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"}
Jul 12 17:42:05.459652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.459482    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx" event={"ID":"82719db1-0aca-4773-9bed-808b9bf8ac48","Type":"ContainerDied","Data":"c1f994a38cc207e3dc15146dcd0f1f8698aee7a80142379c0f25697e9815e2f3"}
Jul 12 17:42:05.459652 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.459512    2584 scope.go:117] "RemoveContainer" containerID="f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"
Jul 12 17:42:05.469175 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.469153    2584 scope.go:117] "RemoveContainer" containerID="f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"
Jul 12 17:42:05.469422 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:05.469403    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1\": container with ID starting with f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1 not found: ID does not exist" containerID="f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"
Jul 12 17:42:05.469487 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.469431    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1"} err="failed to get container status \"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1\": rpc error: code = NotFound desc = could not find container \"f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1\": container with ID starting with f49715c6d363d72af67e832e4827ac5b66acc5bc97eb8afbcc39c5b05d6d69b1 not found: ID does not exist"
Jul 12 17:42:05.482962 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.482921    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:42:05.486408 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:05.486382    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-444d10-7c7df849c5-6w5nx"]
Jul 12 17:42:06.379996 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:06.379960    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82719db1-0aca-4773-9bed-808b9bf8ac48" path="/var/lib/kubelet/pods/82719db1-0aca-4773-9bed-808b9bf8ac48/volumes"
Jul 12 17:42:20.326412 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.326372    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"]
Jul 12 17:42:20.326821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.326727    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82719db1-0aca-4773-9bed-808b9bf8ac48" containerName="maas-api"
Jul 12 17:42:20.326821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.326738    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="82719db1-0aca-4773-9bed-808b9bf8ac48" containerName="maas-api"
Jul 12 17:42:20.326821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.326812    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="82719db1-0aca-4773-9bed-808b9bf8ac48" containerName="maas-api"
Jul 12 17:42:20.329821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.329804    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:20.332341 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.332321    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:42:20.336587 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.336565    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"]
Jul 12 17:42:20.380592 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.380562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p\" (UID: \"696f4362-7ab9-4a33-9122-f7110bb87d40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:20.481982 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.481940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p\" (UID: \"696f4362-7ab9-4a33-9122-f7110bb87d40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:20.482644 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.482622    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p\" (UID: \"696f4362-7ab9-4a33-9122-f7110bb87d40\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:20.641498 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.641466    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:20.774336 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:20.774306    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"]
Jul 12 17:42:20.776087 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:42:20.776061    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696f4362_7ab9_4a33_9122_f7110bb87d40.slice/crio-df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3 WatchSource:0}: Error finding container df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3: Status 404 returned error can't find the container with id df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3
Jul 12 17:42:21.544492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:21.544458    2584 generic.go:356] "Generic (PLEG): container finished" podID="696f4362-7ab9-4a33-9122-f7110bb87d40" containerID="9e910cdd11762dc3487f0edd4a8f73c550cefe01400ef16517f988bb0e2d6371" exitCode=0
Jul 12 17:42:21.544912 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:21.544507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p" event={"ID":"696f4362-7ab9-4a33-9122-f7110bb87d40","Type":"ContainerDied","Data":"9e910cdd11762dc3487f0edd4a8f73c550cefe01400ef16517f988bb0e2d6371"}
Jul 12 17:42:21.544912 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:21.544548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p" event={"ID":"696f4362-7ab9-4a33-9122-f7110bb87d40","Type":"ContainerStarted","Data":"df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3"}
Jul 12 17:42:22.684992 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:22.684966    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:22.802925 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:22.802820    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca\") pod \"696f4362-7ab9-4a33-9122-f7110bb87d40\" (UID: \"696f4362-7ab9-4a33-9122-f7110bb87d40\") "
Jul 12 17:42:22.803152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:22.803125    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "696f4362-7ab9-4a33-9122-f7110bb87d40" (UID: "696f4362-7ab9-4a33-9122-f7110bb87d40"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:42:22.903904 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:22.903847    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/696f4362-7ab9-4a33-9122-f7110bb87d40-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:23.562887 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:23.562851    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p" event={"ID":"696f4362-7ab9-4a33-9122-f7110bb87d40","Type":"ContainerDied","Data":"df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3"}
Jul 12 17:42:23.562887 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:23.562871    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p"
Jul 12 17:42:23.563096 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:23.562926    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df1b82d9a42e01363b6f7eaa18d0b6aae6efd38d81abb01c3aaf7248883198e3"
Jul 12 17:42:30.671389 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.671351    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:42:30.671869 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.671600    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" podUID="1e2d0741-64b2-431e-bcef-10347c39a670" containerName="maas-api" containerID="cri-o://e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8" gracePeriod=30
Jul 12 17:42:30.920045 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.920021    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:42:30.983604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.983503    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") pod \"1e2d0741-64b2-431e-bcef-10347c39a670\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") "
Jul 12 17:42:30.983810 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.983625    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp5zm\" (UniqueName: \"kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm\") pod \"1e2d0741-64b2-431e-bcef-10347c39a670\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") "
Jul 12 17:42:30.983810 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.983672    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca\") pod \"1e2d0741-64b2-431e-bcef-10347c39a670\" (UID: \"1e2d0741-64b2-431e-bcef-10347c39a670\") "
Jul 12 17:42:30.984049 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.984025    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e2d0741-64b2-431e-bcef-10347c39a670" (UID: "1e2d0741-64b2-431e-bcef-10347c39a670"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:42:30.985666 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.985647    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e2d0741-64b2-431e-bcef-10347c39a670" (UID: "1e2d0741-64b2-431e-bcef-10347c39a670"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:42:30.985787 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:30.985757    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm" (OuterVolumeSpecName: "kube-api-access-kp5zm") pod "1e2d0741-64b2-431e-bcef-10347c39a670" (UID: "1e2d0741-64b2-431e-bcef-10347c39a670"). InnerVolumeSpecName "kube-api-access-kp5zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:42:31.085150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.085118    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2d0741-64b2-431e-bcef-10347c39a670-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:31.085150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.085145    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2d0741-64b2-431e-bcef-10347c39a670-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:31.085150 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.085154    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp5zm\" (UniqueName: \"kubernetes.io/projected/1e2d0741-64b2-431e-bcef-10347c39a670-kube-api-access-kp5zm\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:42:31.605808 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.605755    2584 generic.go:356] "Generic (PLEG): container finished" podID="1e2d0741-64b2-431e-bcef-10347c39a670" containerID="e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8" exitCode=0
Jul 12 17:42:31.605983 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.605824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" event={"ID":"1e2d0741-64b2-431e-bcef-10347c39a670","Type":"ContainerDied","Data":"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"}
Jul 12 17:42:31.605983 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.605841    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"
Jul 12 17:42:31.605983 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.605896    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp" event={"ID":"1e2d0741-64b2-431e-bcef-10347c39a670","Type":"ContainerDied","Data":"f10fa29281ec89153886df8c85f7f9b99be06f2df0a17f559312408e58160e1c"}
Jul 12 17:42:31.605983 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.605942    2584 scope.go:117] "RemoveContainer" containerID="e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"
Jul 12 17:42:31.616286 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.616087    2584 scope.go:117] "RemoveContainer" containerID="e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"
Jul 12 17:42:31.616476 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:31.616450    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8\": container with ID starting with e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8 not found: ID does not exist" containerID="e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"
Jul 12 17:42:31.616550 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.616490    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8"} err="failed to get container status \"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8\": rpc error: code = NotFound desc = could not find container \"e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8\": container with ID starting with e8b2ca9004511303078b7cd93b624ab71f98f68566212e2ad4da8239488506e8 not found: ID does not exist"
Jul 12 17:42:31.630843 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.630815    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:42:31.633822 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:31.633799    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2484ca-5d98b46dd7-2vjxp"]
Jul 12 17:42:32.380612 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:32.380582    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2d0741-64b2-431e-bcef-10347c39a670" path="/var/lib/kubelet/pods/1e2d0741-64b2-431e-bcef-10347c39a670/volumes"
Jul 12 17:42:32.613202 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:32.613170    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:42:32.616010 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:32.615984    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:42:49.989482 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.989445    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.989956    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696f4362-7ab9-4a33-9122-f7110bb87d40" containerName="revoke-keys"
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.989974    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="696f4362-7ab9-4a33-9122-f7110bb87d40" containerName="revoke-keys"
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.989999    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2d0741-64b2-431e-bcef-10347c39a670" containerName="maas-api"
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.990008    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2d0741-64b2-431e-bcef-10347c39a670" containerName="maas-api"
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.990102    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2d0741-64b2-431e-bcef-10347c39a670" containerName="maas-api"
Jul 12 17:42:49.990119 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.990117    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="696f4362-7ab9-4a33-9122-f7110bb87d40" containerName="revoke-keys"
Jul 12 17:42:49.993669 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.993648    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:49.996289 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.996266    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 17:42:49.997238 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.997220    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 17:42:49.997238 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.997231    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e767e8-serving-cert\""
Jul 12 17:42:49.997397 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:49.997262    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bljs8\""
Jul 12 17:42:50.003184 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.003114    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:42:50.053158 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.053113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthp7\" (UniqueName: \"kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.053340 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.053251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.053340 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.053289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.154030 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.153987    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.154230 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.154043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.154230 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.154102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthp7\" (UniqueName: \"kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.154230 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:50.154196    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-serving-cert: secret "maas-api-e2e-shared-a-e767e8-serving-cert" not found
Jul 12 17:42:50.154373 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:50.154270    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls podName:1341d5b6-a85c-47de-93e4-d000051eec00 nodeName:}" failed. No retries permitted until 2026-07-12 17:42:50.654254243 +0000 UTC m=+2418.856087478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls") pod "maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" (UID: "1341d5b6-a85c-47de-93e4-d000051eec00") : secret "maas-api-e2e-shared-a-e767e8-serving-cert" not found
Jul 12 17:42:50.154664 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.154644    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.166930 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.166898    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthp7\" (UniqueName: \"kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.658190 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.658153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.660574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.660554    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") pod \"maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:50.906147 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:50.906110    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:51.070885 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:51.070859    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:42:51.071630 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:42:51.071609    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1341d5b6_a85c_47de_93e4_d000051eec00.slice/crio-4c32b2a4dbd479a3788e591f53c3dbb02080ce8391c09558cdf03dc002e15809 WatchSource:0}: Error finding container 4c32b2a4dbd479a3788e591f53c3dbb02080ce8391c09558cdf03dc002e15809: Status 404 returned error can't find the container with id 4c32b2a4dbd479a3788e591f53c3dbb02080ce8391c09558cdf03dc002e15809
Jul 12 17:42:51.717508 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:51.717469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" event={"ID":"1341d5b6-a85c-47de-93e4-d000051eec00","Type":"ContainerStarted","Data":"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"}
Jul 12 17:42:51.717711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:51.717525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" event={"ID":"1341d5b6-a85c-47de-93e4-d000051eec00","Type":"ContainerStarted","Data":"4c32b2a4dbd479a3788e591f53c3dbb02080ce8391c09558cdf03dc002e15809"}
Jul 12 17:42:51.717711 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:51.717565    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:51.734846 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:51.734798    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" podStartSLOduration=2.249345966 podStartE2EDuration="2.734780478s" totalImagesPullingTime="485.434512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:42:51.733330309 +0000 UTC m=+2419.935163581" watchObservedRunningTime="2026-07-12 17:42:51.734780478 +0000 UTC m=+2419.936613726"
Jul 12 17:42:57.727830 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:57.727723    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:42:57.995661 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:57.995579    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:42:57.999323 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:57.999302    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.002102 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.002082    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9c75b6-serving-cert\""
Jul 12 17:42:58.014344 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.014316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:42:58.024833 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.024750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.024989 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.024879    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmbv\" (UniqueName: \"kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.024989 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.024923    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.126434 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.126386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.126659 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.126439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmbv\" (UniqueName: \"kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.126659 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.126472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.126659 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:58.126595    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-serving-cert: secret "maas-api-e2e-shared-b-9c75b6-serving-cert" not found
Jul 12 17:42:58.126852 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:42:58.126685    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls podName:5f2e28f3-b3a1-4c16-976e-ae45a724a8f5 nodeName:}" failed. No retries permitted until 2026-07-12 17:42:58.626664871 +0000 UTC m=+2426.828498108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls") pod "maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" (UID: "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5") : secret "maas-api-e2e-shared-b-9c75b6-serving-cert" not found
Jul 12 17:42:58.127418 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.127385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.144322 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.144296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmbv\" (UniqueName: \"kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.630667 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.630632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.633057 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.633036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:58.915307 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:58.915217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:59.046574 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:59.046491    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:42:59.049576 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:42:59.049548    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2e28f3_b3a1_4c16_976e_ae45a724a8f5.slice/crio-57f2ee837451b1cac3ab24b99ee546622ed48c2de312bc4200f2402f277c9f83 WatchSource:0}: Error finding container 57f2ee837451b1cac3ab24b99ee546622ed48c2de312bc4200f2402f277c9f83: Status 404 returned error can't find the container with id 57f2ee837451b1cac3ab24b99ee546622ed48c2de312bc4200f2402f277c9f83
Jul 12 17:42:59.759635 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:59.759593    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" event={"ID":"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5","Type":"ContainerStarted","Data":"a23c117de0bf5c6935479498a9d6f98abccac14616f56f880aa60fa3bdc3bcc0"}
Jul 12 17:42:59.759860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:59.759693    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" event={"ID":"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5","Type":"ContainerStarted","Data":"57f2ee837451b1cac3ab24b99ee546622ed48c2de312bc4200f2402f277c9f83"}
Jul 12 17:42:59.759860 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:59.759720    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:42:59.779233 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:42:59.779185    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" podStartSLOduration=2.480970084 podStartE2EDuration="2.779171016s" totalImagesPullingTime="298.200932ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:42:59.776035879 +0000 UTC m=+2427.977869148" watchObservedRunningTime="2026-07-12 17:42:59.779171016 +0000 UTC m=+2427.981004272"
Jul 12 17:43:05.772282 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:43:05.772251    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:47:32.647821 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:47:32.647720    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:47:32.652596 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:47:32.652574    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:50:05.795036 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:05.795002    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:50:05.795520 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:05.795250    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" podUID="1341d5b6-a85c-47de-93e4-d000051eec00" containerName="maas-api" containerID="cri-o://0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393" gracePeriod=30
Jul 12 17:50:06.246544 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.246514    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:50:06.391104 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.391072    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca\") pod \"1341d5b6-a85c-47de-93e4-d000051eec00\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") "
Jul 12 17:50:06.391104 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.391112    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") pod \"1341d5b6-a85c-47de-93e4-d000051eec00\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") "
Jul 12 17:50:06.391380 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.391161    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xthp7\" (UniqueName: \"kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7\") pod \"1341d5b6-a85c-47de-93e4-d000051eec00\" (UID: \"1341d5b6-a85c-47de-93e4-d000051eec00\") "
Jul 12 17:50:06.391461 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.391436    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1341d5b6-a85c-47de-93e4-d000051eec00" (UID: "1341d5b6-a85c-47de-93e4-d000051eec00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:50:06.393271 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.393239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1341d5b6-a85c-47de-93e4-d000051eec00" (UID: "1341d5b6-a85c-47de-93e4-d000051eec00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:50:06.393372 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.393288    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7" (OuterVolumeSpecName: "kube-api-access-xthp7") pod "1341d5b6-a85c-47de-93e4-d000051eec00" (UID: "1341d5b6-a85c-47de-93e4-d000051eec00"). InnerVolumeSpecName "kube-api-access-xthp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:50:06.492419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.492372    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xthp7\" (UniqueName: \"kubernetes.io/projected/1341d5b6-a85c-47de-93e4-d000051eec00-kube-api-access-xthp7\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:06.492419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.492411    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1341d5b6-a85c-47de-93e4-d000051eec00-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:06.492419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:06.492425    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1341d5b6-a85c-47de-93e4-d000051eec00-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:07.059423 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.059382    2584 generic.go:356] "Generic (PLEG): container finished" podID="1341d5b6-a85c-47de-93e4-d000051eec00" containerID="0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393" exitCode=0
Jul 12 17:50:07.059874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.059435    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"
Jul 12 17:50:07.059874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.059464    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" event={"ID":"1341d5b6-a85c-47de-93e4-d000051eec00","Type":"ContainerDied","Data":"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"}
Jul 12 17:50:07.059874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.059519    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl" event={"ID":"1341d5b6-a85c-47de-93e4-d000051eec00","Type":"ContainerDied","Data":"4c32b2a4dbd479a3788e591f53c3dbb02080ce8391c09558cdf03dc002e15809"}
Jul 12 17:50:07.059874 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.059542    2584 scope.go:117] "RemoveContainer" containerID="0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"
Jul 12 17:50:07.068959 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.068938    2584 scope.go:117] "RemoveContainer" containerID="0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"
Jul 12 17:50:07.069267 ip-10-0-133-238 kubenswrapper[2584]: E0712 17:50:07.069244    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393\": container with ID starting with 0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393 not found: ID does not exist" containerID="0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"
Jul 12 17:50:07.069308 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.069278    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393"} err="failed to get container status \"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393\": rpc error: code = NotFound desc = could not find container \"0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393\": container with ID starting with 0da312d371c0982e44d15a4d42006374e0920daa64f0f17d19f909cf69445393 not found: ID does not exist"
Jul 12 17:50:07.082518 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.082482    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:50:07.084983 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:07.084955    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e767e8-d94dcd8f5-dp6tl"]
Jul 12 17:50:08.385706 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:08.385673    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1341d5b6-a85c-47de-93e4-d000051eec00" path="/var/lib/kubelet/pods/1341d5b6-a85c-47de-93e4-d000051eec00/volumes"
Jul 12 17:50:21.619348 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.619307    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"]
Jul 12 17:50:21.619862 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.619843    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1341d5b6-a85c-47de-93e4-d000051eec00" containerName="maas-api"
Jul 12 17:50:21.619957 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.619864    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1341d5b6-a85c-47de-93e4-d000051eec00" containerName="maas-api"
Jul 12 17:50:21.620018 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.619987    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1341d5b6-a85c-47de-93e4-d000051eec00" containerName="maas-api"
Jul 12 17:50:21.623205 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.623184    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:21.625885 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.625862    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xzcz\""
Jul 12 17:50:21.629161 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.629133    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"]
Jul 12 17:50:21.729311 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.729265    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm\" (UID: \"74d8a2b7-db5c-4587-a055-bbb12f4418c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:21.830481 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.830441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm\" (UID: \"74d8a2b7-db5c-4587-a055-bbb12f4418c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:21.831079 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.831058    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm\" (UID: \"74d8a2b7-db5c-4587-a055-bbb12f4418c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:21.935234 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:21.935143    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:22.077714 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:22.077057    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"]
Jul 12 17:50:22.140694 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:22.140660    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm" event={"ID":"74d8a2b7-db5c-4587-a055-bbb12f4418c8","Type":"ContainerStarted","Data":"fddb1f74d12ff4bfbb5c45a31c2a8755d812b990859716292c1ad6617655e0ec"}
Jul 12 17:50:23.148492 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:23.148451    2584 generic.go:356] "Generic (PLEG): container finished" podID="74d8a2b7-db5c-4587-a055-bbb12f4418c8" containerID="70383091464b0d862c4b5ba2ef942900d335969bd9c3f9cc8086af48c22117c4" exitCode=0
Jul 12 17:50:23.148919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:23.148540    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm" event={"ID":"74d8a2b7-db5c-4587-a055-bbb12f4418c8","Type":"ContainerDied","Data":"70383091464b0d862c4b5ba2ef942900d335969bd9c3f9cc8086af48c22117c4"}
Jul 12 17:50:24.285745 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:24.285720    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:24.352939 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:24.352858    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca\") pod \"74d8a2b7-db5c-4587-a055-bbb12f4418c8\" (UID: \"74d8a2b7-db5c-4587-a055-bbb12f4418c8\") "
Jul 12 17:50:24.353227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:24.353205    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74d8a2b7-db5c-4587-a055-bbb12f4418c8" (UID: "74d8a2b7-db5c-4587-a055-bbb12f4418c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:50:24.453919 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:24.453825    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74d8a2b7-db5c-4587-a055-bbb12f4418c8-maas-api-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:25.160501 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:25.160460    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm"
Jul 12 17:50:25.160680 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:25.160501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm" event={"ID":"74d8a2b7-db5c-4587-a055-bbb12f4418c8","Type":"ContainerDied","Data":"fddb1f74d12ff4bfbb5c45a31c2a8755d812b990859716292c1ad6617655e0ec"}
Jul 12 17:50:25.160680 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:25.160553    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fddb1f74d12ff4bfbb5c45a31c2a8755d812b990859716292c1ad6617655e0ec"
Jul 12 17:50:31.960977 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:31.960942    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:50:31.961468 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:31.961211    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" podUID="5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" containerName="maas-api" containerID="cri-o://a23c117de0bf5c6935479498a9d6f98abccac14616f56f880aa60fa3bdc3bcc0" gracePeriod=30
Jul 12 17:50:32.431789 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.431747    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:50:32.528932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.528809    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znmbv\" (UniqueName: \"kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv\") pod \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") "
Jul 12 17:50:32.528932 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.528905    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca\") pod \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") "
Jul 12 17:50:32.529168 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.528941    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") pod \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\" (UID: \"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5\") "
Jul 12 17:50:32.529268 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.529243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" (UID: "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:50:32.530965 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.530935    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" (UID: "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:50:32.531093 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.530997    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv" (OuterVolumeSpecName: "kube-api-access-znmbv") pod "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" (UID: "5f2e28f3-b3a1-4c16-976e-ae45a724a8f5"). InnerVolumeSpecName "kube-api-access-znmbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:50:32.630042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.629987    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znmbv\" (UniqueName: \"kubernetes.io/projected/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-kube-api-access-znmbv\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:32.630042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.630032    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-openshift-service-ca\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:32.630042 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.630044    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5-maas-api-tls\") on node \"ip-10-0-133-238.ec2.internal\" DevicePath \"\""
Jul 12 17:50:32.729430 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:32.729399    2584 scope.go:117] "RemoveContainer" containerID="a23c117de0bf5c6935479498a9d6f98abccac14616f56f880aa60fa3bdc3bcc0"
Jul 12 17:50:33.203152 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:33.203119    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"
Jul 12 17:50:33.203554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:33.203119    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" event={"ID":"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5","Type":"ContainerDied","Data":"a23c117de0bf5c6935479498a9d6f98abccac14616f56f880aa60fa3bdc3bcc0"}
Jul 12 17:50:33.203554 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:33.203261    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj" event={"ID":"5f2e28f3-b3a1-4c16-976e-ae45a724a8f5","Type":"ContainerDied","Data":"57f2ee837451b1cac3ab24b99ee546622ed48c2de312bc4200f2402f277c9f83"}
Jul 12 17:50:33.231781 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:33.231737    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:50:33.235743 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:33.235714    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9c75b6-7468b855f6-xg8cj"]
Jul 12 17:50:34.378966 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:34.378924    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" path="/var/lib/kubelet/pods/5f2e28f3-b3a1-4c16-976e-ae45a724a8f5/volumes"
Jul 12 17:50:53.963360 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:53.963326    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554bd9d4cc-6vdv8_4ea339eb-edbe-42c9-8d90-49670c97cfc3/copy-manifests/0.log"
Jul 12 17:50:53.970341 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:53.970320    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554bd9d4cc-6vdv8_4ea339eb-edbe-42c9-8d90-49670c97cfc3/manager/0.log"
Jul 12 17:50:55.134458 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.134426    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-2484ca-t5p5p_696f4362-7ab9-4a33-9122-f7110bb87d40/revoke-keys/0.log"
Jul 12 17:50:55.250069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.250035    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-99b987c8-hrfcf_46e3406c-b784-47ab-98aa-7b91f4f020a6/revoke-keys/0.log"
Jul 12 17:50:55.363645 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.363614    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-c5fd66-b28x4_30554806-a17e-4ea1-8fac-66e759e4a5d4/revoke-keys/0.log"
Jul 12 17:50:55.477032 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.476953    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-7fa4a5-bg9vb_460ad528-e65e-4266-9cd7-d0acb1adc132/revoke-keys/0.log"
Jul 12 17:50:55.712890 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.712863    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-24c431b4-dhm69_a67336b0-eb0e-4bb4-8d97-b55149a3c0ee/revoke-keys/0.log"
Jul 12 17:50:55.833520 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:55.833429    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-d91d15cb-xcgpj_78f76d6a-9267-4629-9143-180b1df34400/revoke-keys/0.log"
Jul 12 17:50:56.082072 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:56.082039    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-9c75b6-hk7qm_74d8a2b7-db5c-4587-a055-bbb12f4418c8/revoke-keys/0.log"
Jul 12 17:50:56.997075 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:56.997046    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/util/0.log"
Jul 12 17:50:57.002814 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.002784    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/pull/0.log"
Jul 12 17:50:57.007996 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.007960    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/extract/0.log"
Jul 12 17:50:57.129011 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.128982    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/util/0.log"
Jul 12 17:50:57.135348 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.135328    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/pull/0.log"
Jul 12 17:50:57.141024 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.141006    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/extract/0.log"
Jul 12 17:50:57.252432 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.252344    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/util/0.log"
Jul 12 17:50:57.258216 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.258195    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/pull/0.log"
Jul 12 17:50:57.263716 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.263696    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/extract/0.log"
Jul 12 17:50:57.377182 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.377155    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/util/0.log"
Jul 12 17:50:57.383069 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.383044    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/pull/0.log"
Jul 12 17:50:57.388559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:57.388541    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/extract/0.log"
Jul 12 17:50:58.729180 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:58.729144    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bnvlz_36eedca2-b34e-43c5-baf4-28152589c9b4/istio-proxy/0.log"
Jul 12 17:50:58.843530 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:58.843499    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lkfb2_557ea33c-ab20-431e-b97a-1287c5c86ff3/discovery/0.log"
Jul 12 17:50:59.177442 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:59.177399    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/1.log"
Jul 12 17:50:59.530493 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:59.530410    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747fb75d5b-hc9gg_179a6916-ac30-4a38-8283-0dbbb8404fbd/router/0.log"
Jul 12 17:50:59.978818 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:50:59.978786    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mkhcn_f253aa89-ba1f-4f76-baa6-d066a2e33553/main/0.log"
Jul 12 17:51:00.088085 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:00.088054    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-79tdh_418c814d-a4e4-4bbc-b743-3edbb2834640/main/0.log"
Jul 12 17:51:07.469177 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:07.469147    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x462c_f022beb1-077c-4449-b0d8-ef5d9897c525/global-pull-secret-syncer/0.log"
Jul 12 17:51:07.556875 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:07.556838    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5422l_83a5cc91-30e8-40f9-8931-d2d9ac327c1c/konnectivity-agent/0.log"
Jul 12 17:51:07.608937 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:07.608904    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-238.ec2.internal_b94e93dfcffd44104222ccfa6f4e9d3f/haproxy/0.log"
Jul 12 17:51:12.261422 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.261314    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/extract/0.log"
Jul 12 17:51:12.285259 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.285233    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/util/0.log"
Jul 12 17:51:12.315795 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.315741    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cxp2c_0ca0eebb-017c-4046-a28a-36f24c8e8ce2/pull/0.log"
Jul 12 17:51:12.342352 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.342329    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/extract/0.log"
Jul 12 17:51:12.365594 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.365564    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/util/0.log"
Jul 12 17:51:12.388604 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.388576    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z99pm_260ee4f1-0875-482f-b81d-4789ba4f741b/pull/0.log"
Jul 12 17:51:12.416315 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.416287    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/extract/0.log"
Jul 12 17:51:12.437217 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.437195    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/util/0.log"
Jul 12 17:51:12.455976 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.455951    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m6fmb_bf0d1f0e-6811-4d51-9e79-efa1cf3dbb5d/pull/0.log"
Jul 12 17:51:12.484102 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.484074    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/extract/0.log"
Jul 12 17:51:12.507254 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.507229    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/util/0.log"
Jul 12 17:51:12.526259 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:12.526182    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wz6g4_44a83e0f-9095-4acd-a0d0-7f8c10643760/pull/0.log"
Jul 12 17:51:15.438630 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:15.438597    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lqx2b_ab429711-deb3-47be-8df4-3054a0680b29/cluster-monitoring-operator/0.log"
Jul 12 17:51:15.749058 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:15.748979    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq5xc_359ad6b3-e60c-49be-819f-f561f1c66cdd/node-exporter/0.log"
Jul 12 17:51:15.768349 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:15.768313    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq5xc_359ad6b3-e60c-49be-819f-f561f1c66cdd/kube-rbac-proxy/0.log"
Jul 12 17:51:15.791261 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:15.791237    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq5xc_359ad6b3-e60c-49be-819f-f561f1c66cdd/init-textfile/0.log"
Jul 12 17:51:16.169629 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:16.169603    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-bwnjt_b4002d79-9681-41b7-8a11-e3a6d3acd4b7/prometheus-operator-admission-webhook/0.log"
Jul 12 17:51:17.492909 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.492881    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-q9txd_3cad6402-e9c7-42bb-9da0-153633513406/networking-console-plugin/0.log"
Jul 12 17:51:17.772533 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.772438    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"]
Jul 12 17:51:17.772900 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.772882    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d8a2b7-db5c-4587-a055-bbb12f4418c8" containerName="revoke-keys"
Jul 12 17:51:17.773000 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.772902    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d8a2b7-db5c-4587-a055-bbb12f4418c8" containerName="revoke-keys"
Jul 12 17:51:17.773000 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.772944    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" containerName="maas-api"
Jul 12 17:51:17.773000 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.772953    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" containerName="maas-api"
Jul 12 17:51:17.773158 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.773037    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2e28f3-b3a1-4c16-976e-ae45a724a8f5" containerName="maas-api"
Jul 12 17:51:17.773158 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.773052    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d8a2b7-db5c-4587-a055-bbb12f4418c8" containerName="revoke-keys"
Jul 12 17:51:17.776197 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.776178    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.779263 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.779242    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rpjth\"/\"default-dockercfg-pfmzn\""
Jul 12 17:51:17.780049 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.780032    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpjth\"/\"kube-root-ca.crt\""
Jul 12 17:51:17.780134 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.780068    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpjth\"/\"openshift-service-ca.crt\""
Jul 12 17:51:17.784945 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.784922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"]
Jul 12 17:51:17.813408 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.813378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292kt\" (UniqueName: \"kubernetes.io/projected/69ea9c67-ec04-487b-8a2c-14701ee542b0-kube-api-access-292kt\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.813603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.813420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-sys\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.813603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.813447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-lib-modules\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.813603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.813491    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-proc\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.813603 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.813524    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-podres\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.914851 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.914811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292kt\" (UniqueName: \"kubernetes.io/projected/69ea9c67-ec04-487b-8a2c-14701ee542b0-kube-api-access-292kt\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.914863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-sys\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.914888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-lib-modules\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.914909    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-proc\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.914941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-podres\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.915015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-sys\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.915015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-proc\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915064 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.915057    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-podres\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.915370 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.915068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69ea9c67-ec04-487b-8a2c-14701ee542b0-lib-modules\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:17.922170 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:17.922149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-292kt\" (UniqueName: \"kubernetes.io/projected/69ea9c67-ec04-487b-8a2c-14701ee542b0-kube-api-access-292kt\") pod \"perf-node-gather-daemonset-47b5s\" (UID: \"69ea9c67-ec04-487b-8a2c-14701ee542b0\") " pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:18.087098 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.086992    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:18.116172 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.116139    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/1.log"
Jul 12 17:51:18.121192 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.121171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pzm79_3b88f1c8-6213-4002-95bc-6d813a8a9379/console-operator/2.log"
Jul 12 17:51:18.221509 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.221480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"]
Jul 12 17:51:18.223541 ip-10-0-133-238 kubenswrapper[2584]: W0712 17:51:18.223513    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69ea9c67_ec04_487b_8a2c_14701ee542b0.slice/crio-90f20f18e901652cefa81d054a839116693733baa7c7986db64cf8cec2be35f1 WatchSource:0}: Error finding container 90f20f18e901652cefa81d054a839116693733baa7c7986db64cf8cec2be35f1: Status 404 returned error can't find the container with id 90f20f18e901652cefa81d054a839116693733baa7c7986db64cf8cec2be35f1
Jul 12 17:51:18.457494 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.457446    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s" event={"ID":"69ea9c67-ec04-487b-8a2c-14701ee542b0","Type":"ContainerStarted","Data":"444936d14c3e0568f0691d752a02685f8e3cd830a4ca02db6e0b3ef52031ec51"}
Jul 12 17:51:18.457672 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.457517    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:18.457672 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.457542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s" event={"ID":"69ea9c67-ec04-487b-8a2c-14701ee542b0","Type":"ContainerStarted","Data":"90f20f18e901652cefa81d054a839116693733baa7c7986db64cf8cec2be35f1"}
Jul 12 17:51:18.475911 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.475858    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s" podStartSLOduration=1.475842342 podStartE2EDuration="1.475842342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:51:18.474451276 +0000 UTC m=+2926.676284535" watchObservedRunningTime="2026-07-12 17:51:18.475842342 +0000 UTC m=+2926.677675598"
Jul 12 17:51:18.727161 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:18.727131    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-nzvx6_e5eb002f-0c8a-484b-8d26-f73765e5747f/download-server/0.log"
Jul 12 17:51:19.301822 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:19.301785    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-wmfrm_a2a34578-edca-44cc-b25f-46b4cf504258/volume-data-source-validator/0.log"
Jul 12 17:51:20.424422 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:20.424372    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4dk5_6708a039-3106-4d72-a749-d8503371e856/dns/0.log"
Jul 12 17:51:20.443419 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:20.443390    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4dk5_6708a039-3106-4d72-a749-d8503371e856/kube-rbac-proxy/0.log"
Jul 12 17:51:20.485516 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:20.485484    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsdxt_6a2bf471-5e6a-4800-add6-0cd85482041f/dns-node-resolver/0.log"
Jul 12 17:51:21.043834 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:21.043804    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cgc76_d61dc20c-65cc-4d35-a1f8-614b6c2c8abb/node-ca/0.log"
Jul 12 17:51:21.957883 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:21.957849    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bnvlz_36eedca2-b34e-43c5-baf4-28152589c9b4/istio-proxy/0.log"
Jul 12 17:51:22.074548 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:22.074516    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lkfb2_557ea33c-ab20-431e-b97a-1287c5c86ff3/discovery/0.log"
Jul 12 17:51:22.141273 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:22.141205    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/0.log"
Jul 12 17:51:22.171457 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:22.171420    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/1.log"
Jul 12 17:51:22.267190 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:22.267091    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747fb75d5b-hc9gg_179a6916-ac30-4a38-8283-0dbbb8404fbd/router/0.log"
Jul 12 17:51:22.943407 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:22.943376    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8jxs8_3cf8d144-ae74-44b4-9abb-c71aecbfc765/serve-healthcheck-canary/0.log"
Jul 12 17:51:23.424908 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:23.424864    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s8c28_79beeb21-6958-476f-b8e0-738d0e543390/insights-operator/0.log"
Jul 12 17:51:23.425498 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:23.425202    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s8c28_79beeb21-6958-476f-b8e0-738d0e543390/insights-operator/1.log"
Jul 12 17:51:23.573337 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:23.573305    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zltng_9b9bb4a5-1579-4068-937d-d620c91fa0d9/kube-rbac-proxy/0.log"
Jul 12 17:51:23.592640 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:23.592605    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zltng_9b9bb4a5-1579-4068-937d-d620c91fa0d9/exporter/0.log"
Jul 12 17:51:23.614269 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:23.614237    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zltng_9b9bb4a5-1579-4068-937d-d620c91fa0d9/extractor/0.log"
Jul 12 17:51:24.472002 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:24.471976    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rpjth/perf-node-gather-daemonset-47b5s"
Jul 12 17:51:26.238073 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:26.238042    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554bd9d4cc-6vdv8_4ea339eb-edbe-42c9-8d90-49670c97cfc3/manager/0.log"
Jul 12 17:51:26.257342 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:26.257315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554bd9d4cc-6vdv8_4ea339eb-edbe-42c9-8d90-49670c97cfc3/copy-manifests/0.log"
Jul 12 17:51:27.833374 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:27.833333    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6459574568-klwtj_c429177e-9f6f-4db2-8ef7-b50463fbae8e/manager/0.log"
Jul 12 17:51:28.738385 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:28.738356    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bnvlz_36eedca2-b34e-43c5-baf4-28152589c9b4/istio-proxy/0.log"
Jul 12 17:51:28.850008 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:28.849975    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lkfb2_557ea33c-ab20-431e-b97a-1287c5c86ff3/discovery/0.log"
Jul 12 17:51:28.899876 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:28.899839    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/0.log"
Jul 12 17:51:28.928792 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:28.928748    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/1.log"
Jul 12 17:51:29.012799 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:29.012709    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747fb75d5b-hc9gg_179a6916-ac30-4a38-8283-0dbbb8404fbd/router/0.log"
Jul 12 17:51:30.285267 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:30.285237    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bnvlz_36eedca2-b34e-43c5-baf4-28152589c9b4/istio-proxy/0.log"
Jul 12 17:51:30.398420 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:30.398388    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lkfb2_557ea33c-ab20-431e-b97a-1287c5c86ff3/discovery/0.log"
Jul 12 17:51:30.448425 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:30.448394    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/0.log"
Jul 12 17:51:30.475634 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:30.475599    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6vrq6_0961c9de-6beb-46ae-9128-f6fc8c00dcac/istio-proxy/1.log"
Jul 12 17:51:30.551694 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:30.551622    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-747fb75d5b-hc9gg_179a6916-ac30-4a38-8283-0dbbb8404fbd/router/0.log"
Jul 12 17:51:32.904359 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:32.904323    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-88knx_a2cc183b-751a-42d9-92ba-ed2ce07173e4/migrator/0.log"
Jul 12 17:51:32.924146 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:32.924119    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-88knx_a2cc183b-751a-42d9-92ba-ed2ce07173e4/graceful-termination/0.log"
Jul 12 17:51:33.287581 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:33.287496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tvgmn_e046bc82-fccb-43ba-9460-b5ad8c40fd05/kube-storage-version-migrator-operator/1.log"
Jul 12 17:51:33.288227 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:33.288210    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tvgmn_e046bc82-fccb-43ba-9460-b5ad8c40fd05/kube-storage-version-migrator-operator/0.log"
Jul 12 17:51:34.300427 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.300344    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/kube-multus-additional-cni-plugins/0.log"
Jul 12 17:51:34.319947 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.319921    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/egress-router-binary-copy/0.log"
Jul 12 17:51:34.339191 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.339162    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/cni-plugins/0.log"
Jul 12 17:51:34.358559 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.358531    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/bond-cni-plugin/0.log"
Jul 12 17:51:34.378215 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.378181    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/routeoverride-cni/0.log"
Jul 12 17:51:34.398134 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.398104    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/whereabouts-cni-bincopy/0.log"
Jul 12 17:51:34.417037 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.417011    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ljxvg_4824959f-2ceb-4881-a948-d97585094606/whereabouts-cni/0.log"
Jul 12 17:51:34.761732 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.761703    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z82br_98c1cfc8-e092-430a-a10b-e494ded47663/kube-multus/0.log"
Jul 12 17:51:34.780395 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.780362    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hphh_6284bb2f-3b84-4586-92d0-ce568d42cb91/network-metrics-daemon/0.log"
Jul 12 17:51:34.799137 ip-10-0-133-238 kubenswrapper[2584]: I0712 17:51:34.799110    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hphh_6284bb2f-3b84-4586-92d0-ce568d42cb91/kube-rbac-proxy/0.log"