Jul 27 20:02:05.109147 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 20:02:05.109157 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 20:02:05.109165 ip-10-0-133-107 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 20:02:05.109473 ip-10-0-133-107 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 20:02:15.198928 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 20:02:15.198944 ip-10-0-133-107 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 657e1839d07544c99ecd64fdd4130d98 --
Jul 27 20:03:48.687441 ip-10-0-133-107 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:03:49.087095 ip-10-0-133-107 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:03:49.087095 ip-10-0-133-107 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:03:49.087095 ip-10-0-133-107 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:03:49.087095 ip-10-0-133-107 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:03:49.087095 ip-10-0-133-107 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:03:49.087749 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.087077    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:03:49.091386 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091369    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.091386 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091385    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091389    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091392    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091395    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091399    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091402    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091405    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091408    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091410    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091413    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091416    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091418    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091421    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091424    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091426    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091429    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091431    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091441    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091444    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091447    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.091451 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091449    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091452    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091455    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091460    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091464    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091467    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091470    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091472    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091475    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091478    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091480    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091483    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091485    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091488    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091491    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091494    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091496    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091499    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091501    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091504    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.091927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091507    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091510    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091514    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091518    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091521    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091524    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091527    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091530    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091534    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091537    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091542    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091545    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091548    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091551    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091554    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091556    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091559    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091561    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091564    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.092426 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091567    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091569    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091572    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091574    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091577    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091580    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091583    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091585    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091588    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091590    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091593    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091597    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091600    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091602    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091605    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091608    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091611    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091613    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091616    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091618    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.092927 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091621    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091623    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091626    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091629    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091631    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091634    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091637    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091640    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091643    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091645    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091648    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091650    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091653    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091655    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091658    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091660    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091663    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091666    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.091668    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092378    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.093425 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092386    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092389    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092391    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092394    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092397    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092401    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092405    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092408    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092410    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092413    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092415    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092418    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092421    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092423    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092426    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092429    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092431    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092435    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092439    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.093905 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092441    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092444    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092446    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092449    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092451    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092454    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092456    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092459    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092461    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092464    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092466    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092469    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092472    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092474    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092477    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092479    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092482    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092485    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092487    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092490    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.094384 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092493    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092495    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092498    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092501    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092504    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092507    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092510    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092512    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092516    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092519    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092523    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092527    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092530    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092532    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092535    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092538    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092540    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092543    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092546    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.094873 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092549    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092551    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092554    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092558    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092561    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092563    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092566    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092571    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092574    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092577    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092580    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092583    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092586    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092588    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092591    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092594    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092596    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092600    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092602    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092605    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.095346 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092608    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092610    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092613    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092615    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092618    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092620    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092623    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092626    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092628    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092630    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092633    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092635    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092638    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092640    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092643    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092646    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092648    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092651    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092653    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.092656    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.095916 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093020    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093025    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093029    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093032    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093034    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093037    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093040    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093042    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093045    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093050    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093053    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093056    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093059    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093061    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093064    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093067    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093069    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093073    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093075    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093078    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.096629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093081    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093083    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093086    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093088    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093091    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093101    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093104    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093107    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093109    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093112    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093115    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093117    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093120    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093123    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093125    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093128    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093131    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093133    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093136    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093138    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.097139 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093141    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093145    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093147    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093150    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093153    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093155    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093158    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093161    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093164    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093166    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093172    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093188    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093191    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093194    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093197    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093199    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093202    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093204    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093207    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093209    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.097648 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093212    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093214    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093217    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093219    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093222    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093224    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093227    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093229    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093232    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093234    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093237    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093239    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093242    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093245    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093248    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093251    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093254    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093257    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093259    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.098164 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093262    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093266    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093269    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093271    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093274    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093277    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093280    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093282    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093286    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093288    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093291    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093293    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093296    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093298    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093300    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093303    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093305    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093308    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093312    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.098641 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.093315    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093384    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093391    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093400    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093408    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093414    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093419    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093428    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093433    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093438    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093441    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093445    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093448    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093452    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093455    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093458    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093461    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093464    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093467    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093472    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093475    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093477    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093481    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093484    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:03:49.099102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093488    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093491    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093494    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093497    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093500    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093503    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093506    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093509    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093512    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093516    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093519    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093522    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093526    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093529    2575 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093532    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093537    2575 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093540    2575 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093545    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093548    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093551    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093555    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093558    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093561    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093564    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093567    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:03:49.099679 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093570    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093573    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093576    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093579    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093582    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093585    2575 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093589    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093591    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093594    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093597    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093601    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093603    2575 flags.go:64] FLAG: --help="false"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093606    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093609    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093612    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093615    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093618    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093621    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093624    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093627    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093630    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093633    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093637    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093640    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:03:49.100436 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093645    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093648    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093651    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093654    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093657    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093660    2575 flags.go:64] FLAG: --lock-file=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093663    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093666    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093668    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093674    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093677    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093681    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093683    2575 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093686    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093690    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093692    2575 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093695    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093699    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093702    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093707    2575 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093710    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093713    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093715    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093718    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093721    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:03:49.101019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093724    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093727    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093734    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093737    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093740    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093745    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093747    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093755    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093758    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093761    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093764    2575 flags.go:64] FLAG: --port="10250"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093767    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093770    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f5c002bef9d0df55"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093773    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093775    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093779    2575 flags.go:64] FLAG: --register-node="true"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093781    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093785    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093788    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093791    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093794    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093798    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093801    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093803    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093806    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:03:49.101701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093809    2575 flags.go:64] FLAG: --runonce="false"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093812    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093815    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093818    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093820    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093824    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093827    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093830    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093833    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093836    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093838    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093841    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093844    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093848    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093853    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093856    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093861    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093864    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093867    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093871    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093874    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093877    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093879    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093882    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093885    2575 flags.go:64] FLAG: --v="2"
Jul 27 20:03:49.102324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093889    2575 flags.go:64] FLAG: --version="false"
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093894    2575 flags.go:64] FLAG: --vmodule=""
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093898    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.093901    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094016    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094020    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094023    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094025    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094028    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094031    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094033    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094036    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094039    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094041    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094044    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094048    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094051    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094054    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094057    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094059    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.102933 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094063    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094067    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094069    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094072    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094075    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094077    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094080    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094084    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094087    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094090    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094093    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094095    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094098    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094101    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094103    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094106    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094109    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094111    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094114    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.103512 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094117    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094120    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094122    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094124    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094127    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094129    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094132    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094134    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094136    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094139    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094142    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094145    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094147    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094150    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094155    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094158    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094160    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094162    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094165    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094167    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.103980 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094170    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094172    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094187    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094190    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094192    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094195    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094198    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094200    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094203    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094205    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094208    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094211    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094213    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094216    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094218    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094221    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094223    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094226    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094228    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.104492 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094232    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094235    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094238    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094241    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094244    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094247    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094250    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094255    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094258    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094261    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094263    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094266    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094269    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094271    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094274    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094276    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094279    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094281    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094284    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094287    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.104965 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094289    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094292    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094294    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094297    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.094300    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.094971    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.103712    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.103730    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.104552    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.104563    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104619    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104625    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104628    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104631    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104635    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.105479 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104638    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104641    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104643    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104646    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104662    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104666    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104669    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104672    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104675    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104679    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104682    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104685    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104688    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104690    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104693    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104696    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104698    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104700    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104703    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104706    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.105854 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104709    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104712    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104714    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104717    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104720    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104723    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104726    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104728    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104731    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104734    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104737    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104739    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104742    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104745    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104747    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104750    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104752    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104755    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104758    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.106364 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104760    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104764    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104769    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104772    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104775    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104777    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104780    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104782    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104785    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104787    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104790    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104792    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104795    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104797    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104800    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104802    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104805    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104809    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104812    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.106847 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104814    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104817    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104820    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104822    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104825    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104827    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104830    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104832    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104835    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104838    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104840    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104843    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104846    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104848    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104851    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104855    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104859    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104862    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104865    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.107349 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104868    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104871    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104873    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104876    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104879    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104882    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104884    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104888    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104891    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104893    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104896    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104899    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104902    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104904    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104907    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104910    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.107823 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.104912    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.104917    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105032    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105038    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105041    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105044    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105047    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105050    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105052    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105054    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105057    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105060    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105062    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105065    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105068    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:03:49.108310 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105070    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105073    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105075    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105078    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105080    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105083    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105085    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105088    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105090    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105093    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105104    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105107    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105110    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105114    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105119    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105121    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105125    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105128    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105131    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:03:49.108682 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105134    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105137    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105140    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105143    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105146    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105149    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105151    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105154    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105156    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105159    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105161    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105164    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105166    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105170    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105187    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105192    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105194    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105197    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105200    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105202    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:03:49.109152 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105205    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105208    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105210    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105213    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105216    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105219    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105224    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105227    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105231    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105233    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105236    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105239    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105242    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105245    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105248    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105251    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105254    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105257    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105260    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:03:49.109659 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105262    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105265    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105268    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105270    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105273    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105276    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105278    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105282    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105285    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105287    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105290    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105293    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105295    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105298    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105300    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105303    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105305    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105308    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105310    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105313    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:03:49.110115 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105315    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105318    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105321    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105323    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105326    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105328    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105331    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:49.105333    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.105339    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.105475    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.107567    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.109244    2575 server.go:1019] "Starting client certificate rotation"
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.109345    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:03:49.110609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.110188    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:03:49.112250 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.112235    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:03:49.113658 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.113643    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:03:49.122525 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.122510    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:03:49.126148 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.126132    2575 log.go:25] "Validated CRI v1 image API"
Jul 27 20:03:49.126978 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.126959    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:03:49.129948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.129923    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a4321c1a-d57e-421b-a0fc-e1590c038df5:/dev/nvme0n1p4 b3584cbb-a5a6-47ac-8ee4-67ac3d089c7f:/dev/nvme0n1p3]
Jul 27 20:03:49.130013 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.129950    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:03:49.136434 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.136303    2575 manager.go:216] Machine: {Timestamp:2026-07-27 20:03:49.135013533 +0000 UTC m=+0.328791924 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099860 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe9756dba5e0bf3a23d6b2ddd42e0 SystemUUID:ec2fe975-6dba-5e0b-f3a2-3d6b2ddd42e0 BootID:657e1839-d075-44c9-9ecd-64fdd4130d98 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:3d:b6:e7:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:3d:b6:e7:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:f7:03:6d:ff:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:03:49.136434 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.136423    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:03:49.136560 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.136509    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:03:49.138498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.138479    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:03:49.139713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.139684    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:03:49.139880 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.139719    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:03:49.140510 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.140497    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:03:49.140561 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.140515    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:03:49.140561 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.140526    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:03:49.141319 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.141307    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:03:49.142564 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.142552    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:03:49.145465 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145450    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:03:49.145601 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145590    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:03:49.145657 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145629    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:03:49.145657 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145644    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:03:49.145736 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145660    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:03:49.145736 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145675    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:03:49.145736 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.145687    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:03:49.146091 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.146076    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:03:49.146154 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.146102    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:03:49.148806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.148791    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:03:49.150341 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150328    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:03:49.150394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150359    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:03:49.150955 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150945    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:03:49.150992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150960    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:03:49.150992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150967    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:03:49.150992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150973    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:03:49.150992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150981    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:03:49.150992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.150987    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151067    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151074    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151080    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151085    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151101    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:03:49.151118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.151109    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:03:49.152702 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.152688    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:03:49.152752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.152704    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:03:49.155814 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.155800    2575 server.go:1268] "Started kubelet"
Jul 27 20:03:49.155923 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.155887    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:03:49.156145 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.155894    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:03:49.156372 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.156355    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:03:49.156783 ip-10-0-133-107 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:03:49.158065 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.158034    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:03:49.158295 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.158211    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:03:49.158295 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.158210    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:03:49.158295 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.158215    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:03:49.159247 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.159233    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:03:49.162931 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.162903    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:03:49.165479 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.164496    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e24960718e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.155772649 +0000 UTC m=+0.349551021,LastTimestamp:2026-07-27 20:03:49.155772649 +0000 UTC m=+0.349551021,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.166145 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.166131    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:03:49.166570 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.166555    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:03:49.169223 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.169196    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.169868 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.169841    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:03:49.169868 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.169842    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:03:49.169868 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.169867    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:03:49.170051 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.169948    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:03:49.170051 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.169956    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:03:49.170227 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170213    2575 factory.go:153] Registering CRI-O factory
Jul 27 20:03:49.170282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170249    2575 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:03:49.170484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170465    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:03:49.170552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170485    2575 factory.go:55] Registering systemd factory
Jul 27 20:03:49.170552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170500    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:03:49.170552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170545    2575 factory.go:103] Registering Raw factory
Jul 27 20:03:49.170672 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.170564    2575 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:03:49.171371 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.171343    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:03:49.171478 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.171457    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:03:49.172695 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.172670    2575 manager.go:349] Starting recovery of all containers
Jul 27 20:03:49.184004 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.183977    2575 manager.go:354] Recovery completed
Jul 27 20:03:49.185788 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.185765    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 20:03:49.189242 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.189227    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.191254 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191236    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.191321 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191269    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.191321 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191281    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.191902 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191887    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:03:49.191902 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191895    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.192027 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.191901    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:03:49.192027 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.192012    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:03:49.192112 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.192079    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6csp"
Jul 27 20:03:49.192806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.192792    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.192870 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.192819    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.192870 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.192828    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.198376 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.198360    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6csp"
Jul 27 20:03:49.203486 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.203404    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e24982488e5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.191256293 +0000 UTC m=+0.385034664,LastTimestamp:2026-07-27 20:03:49.191256293 +0000 UTC m=+0.385034664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.212190 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.212107    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e249824d1d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.191274961 +0000 UTC m=+0.385053334,LastTimestamp:2026-07-27 20:03:49.191274961 +0000 UTC m=+0.385053334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.220259 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.220160    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e249824f69c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.19128438 +0000 UTC m=+0.385062751,LastTimestamp:2026-07-27 20:03:49.19128438 +0000 UTC m=+0.385062751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.227882 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.227802    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-107.ec2.internal.18c63e24982488e5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e24982488e5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.191256293 +0000 UTC m=+0.385034664,LastTimestamp:2026-07-27 20:03:49.192805185 +0000 UTC m=+0.386583557,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.239153 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.239101    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-107.ec2.internal.18c63e249824d1d1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e249824d1d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.191274961 +0000 UTC m=+0.385053334,LastTimestamp:2026-07-27 20:03:49.192823708 +0000 UTC m=+0.386602080,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.248117 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.248055    2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-107.ec2.internal.18c63e249824f69c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18c63e249824f69c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-07-27 20:03:49.19128438 +0000 UTC m=+0.385062751,LastTimestamp:2026-07-27 20:03:49.192832611 +0000 UTC m=+0.386610983,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
Jul 27 20:03:49.270263 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.270242    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.369635 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.369562    2575 policy_none.go:49] "None policy: Start"
Jul 27 20:03:49.369635 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.369611    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:03:49.369635 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.369628    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:03:49.370463 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.370440    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.370791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.370776    2575 policy_none.go:47] "Start"
Jul 27 20:03:49.389403 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.387952    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-107.ec2.internal\" not found" node="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.406811 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.406793    2575 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:03:49.406897 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.406831    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:03:49.406897 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.406842    2575 server.go:87] "Starting device plugin registration server"
Jul 27 20:03:49.407136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.407118    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:03:49.407253 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.407134    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:03:49.407327 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.407309    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:03:49.407416 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.407395    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:03:49.407416 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.407408    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:03:49.408135 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.408105    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:03:49.408242 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.408154    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.416413 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.416386    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:03:49.417543 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.417525    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:03:49.417629 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.417557    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:03:49.417629 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.417577    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:03:49.417629 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.417606    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:03:49.419835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.419818    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:03:49.508133 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.508102    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.509207 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.509171    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.509344 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.509223    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.509344 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.509244    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.509344 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.509274    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.518367 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.518346    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"]
Jul 27 20:03:49.518485 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.518404    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.519216 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.519201    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.519290 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.519222    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-107.ec2.internal\": node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.519836 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.519816    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.519923 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.519845    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.519923 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.519855    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.522318 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.522300    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.522488 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.522473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.522570 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.522506    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.523663 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523645    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.523663 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523671    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.523818 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523695    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.523818 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523708    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.523818 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523676    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.523818 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.523758    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.524915 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.524899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.525015 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.524929    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:49.526507 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.526492    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:49.526598 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.526514    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:49.526598 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.526524    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:49.537283 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.537266    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.557958 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.557938    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-107.ec2.internal\" not found" node="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.562294 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.562277    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-107.ec2.internal\" not found" node="ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.571866 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.571850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.571936 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.571873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.571936 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.571890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18c11acd5cd8d4a73c3376324fc2305f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"18c11acd5cd8d4a73c3376324fc2305f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.637780 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.637719    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.672488 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.672589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.672589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18c11acd5cd8d4a73c3376324fc2305f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"18c11acd5cd8d4a73c3376324fc2305f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.672589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.672589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ee66b5b05b527d148b1ad9fbf1afb99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4ee66b5b05b527d148b1ad9fbf1afb99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.672589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.672562    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18c11acd5cd8d4a73c3376324fc2305f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"18c11acd5cd8d4a73c3376324fc2305f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.738639 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.738601    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.839192 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.839141    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:49.860324 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.860300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.865730 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:49.865712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:49.940166 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:49.940087    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:50.040541 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:50.040519    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:50.108023 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.108002    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:03:50.108419 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.108153    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:03:50.141371 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:50.141341    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:50.242107 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:50.242071    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:50.309884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.309854    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:03:50.331837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.331814    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:03:50.333431 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.333406    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:03:50.333536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.333455    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:03:50.333536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.333475    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:03:50.336115 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.336095    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:03:50.343050 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:50.343030    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
Jul 27 20:03:50.346408 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.346390    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:03:50.370378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.370349    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:50.372536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.372496    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:58:49 +0000 UTC" deadline="2027-12-26 12:08:36.956536934 +0000 UTC"
Jul 27 20:03:50.372626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.372538    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12400h4m46.584003871s"
Jul 27 20:03:50.385124 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.385098    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:03:50.386274 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.386242    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
Jul 27 20:03:50.394053 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.394029    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:03:50.416861 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:50.416820    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee66b5b05b527d148b1ad9fbf1afb99.slice/crio-d1b44747c5061ef34e95e7715e3195f6473ebbf31974757fca05aea636dc7813 WatchSource:0}: Error finding container d1b44747c5061ef34e95e7715e3195f6473ebbf31974757fca05aea636dc7813: Status 404 returned error can't find the container with id d1b44747c5061ef34e95e7715e3195f6473ebbf31974757fca05aea636dc7813
Jul 27 20:03:50.417514 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:50.417495    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c11acd5cd8d4a73c3376324fc2305f.slice/crio-610515b1b7b2c7794b2ece15bca4ae85087c5d7d47b114058e1d916cfa5baaef WatchSource:0}: Error finding container 610515b1b7b2c7794b2ece15bca4ae85087c5d7d47b114058e1d916cfa5baaef: Status 404 returned error can't find the container with id 610515b1b7b2c7794b2ece15bca4ae85087c5d7d47b114058e1d916cfa5baaef
Jul 27 20:03:50.422758 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:50.422734    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:03:51.016702 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.016669    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:03:51.146859 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.146827    2575 apiserver.go:52] "Watching apiserver"
Jul 27 20:03:51.154323 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.154294    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:03:51.154915 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.154888    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dgxdm","openshift-multus/multus-8zspx","openshift-multus/network-metrics-daemon-jlwcv","openshift-network-diagnostics/network-check-target-9xzfv","openshift-network-operator/iptables-alerter-wcpr8","kube-system/konnectivity-agent-trcg4","kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal","openshift-image-registry/node-ca-7gj2n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-xpp7h","openshift-ovn-kubernetes/ovnkube-node-gbkl2","kube-system/global-pull-secret-syncer-wqggf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs","openshift-cluster-node-tuning-operator/tuned-zkt8h"]
Jul 27 20:03:51.156628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.156600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.157758 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.157734    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.159185 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.159161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.159299 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.159268    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:03:51.160442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.160410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:51.160569 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.160477    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:03:51.161297 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.161266    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.161582 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.161561    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.161792 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.161777    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:03:51.161900 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.161875    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:03:51.162010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.161994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qnnjz\""
Jul 27 20:03:51.162183 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.162156    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bkhpj\""
Jul 27 20:03:51.162296 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.162197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:03:51.162533 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.162515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.162610 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.162588    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:03:51.162837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.162595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.165033 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.165011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.165862 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.165840    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.167304 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.167282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.169299 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.169249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.170230 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.170200    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:03:51.171691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.171663    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.172691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.171900    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.172691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.172115    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.172691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.172357    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ffgf6\""
Jul 27 20:03:51.172691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.172528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:03:51.172691 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.172664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.174183 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.174164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.175886 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.175865    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.175990 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.175872    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.176335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.176509    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.176812    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177441    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177540    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.177668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177659    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m4g4\""
Jul 27 20:03:51.178105 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.177704    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:03:51.178105 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:03:51.178105 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.177794    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:03:51.178887 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.178867    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-89djn\""
Jul 27 20:03:51.179123 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.179105    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxzhx\""
Jul 27 20:03:51.179336 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.179320    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mz4gq\""
Jul 27 20:03:51.179536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.179521    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9lpf6\""
Jul 27 20:03:51.179949 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.179933    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:03:51.180021 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.180002    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:03:51.180908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.180886    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:03:51.181875 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6hq8\" (UniqueName: \"kubernetes.io/projected/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-kube-api-access-k6hq8\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.181966 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:51.181966 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.181966 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-modprobe-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-conf\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.181995    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-multus\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-etc-kubernetes\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cnibin\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-host\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-netns\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-hostroot\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-registration-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-tuned\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-os-release\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-kubelet\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwvx\" (UniqueName: \"kubernetes.io/projected/892d7c90-3031-411c-a2ad-5d28859b21b2-kube-api-access-pmwvx\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fcfdac9-7588-48a3-bdc7-ee54713f0431-agent-certs\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-systemd\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cnibin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-tmp\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wksx5\" (UniqueName: \"kubernetes.io/projected/5cfe87db-d6b5-424f-84ef-1143c76da5f5-kube-api-access-wksx5\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-socket-dir-parent\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182604    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.182653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbs8\" (UniqueName: \"kubernetes.io/projected/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-kube-api-access-bnbs8\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljfg\" (UniqueName: \"kubernetes.io/projected/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-kube-api-access-fljfg\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-conf-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-socket-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182960    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.182962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-system-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-os-release\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-kubernetes\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-var-lib-kubelet\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-multus-certs\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-run\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-k8s-cni-cncf-io\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183207    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-bin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.183362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-device-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-sys-fs\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183358    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8fvm6\""
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-sys\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fcfdac9-7588-48a3-bdc7-ee54713f0431-konnectivity-ca\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysconfig\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-lib-modules\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtwlq\" (UniqueName: \"kubernetes.io/projected/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-kube-api-access-jtwlq\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-host-slash\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cfe87db-d6b5-424f-84ef-1143c76da5f5-host\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cfe87db-d6b5-424f-84ef-1143c76da5f5-serviceca\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cni-binary-copy\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-daemon-config\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhfr\" (UniqueName: \"kubernetes.io/projected/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-kube-api-access-7xhfr\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.184009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.183816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-iptables-alerter-script\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.189119 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.188939    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:03:51.214430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.214399    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sb7w5"
Jul 27 20:03:51.225446 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.225023    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sb7w5"
Jul 27 20:03:51.271250 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.271180    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:03:51.283995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.283963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.284128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-socket-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.284128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-netns\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-dbus\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.284128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-system-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-os-release\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-kubernetes\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-var-lib-kubelet\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2j9\" (UniqueName: \"kubernetes.io/projected/d5c581f1-c084-4699-8fe7-ca240de9088a-kube-api-access-2m2j9\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-multus-certs\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-etc-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-config\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-run\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.284422 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-k8s-cni-cncf-io\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-bin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-device-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-sys-fs\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53761cb1-df13-4c43-ae36-69c409c4aeae-hosts-file\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-kubelet-config\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-sys\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-var-lib-kubelet\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-kubelet\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-multus-certs\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-systemd-units\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-bin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.284873 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-systemd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-var-lib-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-node-log\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-run\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fcfdac9-7588-48a3-bdc7-ee54713f0431-konnectivity-ca\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.284990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-k8s-cni-cncf-io\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-kubernetes\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-sys-fs\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysconfig\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-lib-modules\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-os-release\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-socket-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtwlq\" (UniqueName: \"kubernetes.io/projected/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-kube-api-access-jtwlq\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.285607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-device-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-host-slash\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-host-slash\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-system-cni-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysconfig\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-env-overrides\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-sys\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5c581f1-c084-4699-8fe7-ca240de9088a-ovn-node-metrics-cert\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cfe87db-d6b5-424f-84ef-1143c76da5f5-host\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-lib-modules\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cfe87db-d6b5-424f-84ef-1143c76da5f5-serviceca\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cni-binary-copy\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cfe87db-d6b5-424f-84ef-1143c76da5f5-host\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-daemon-config\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhfr\" (UniqueName: \"kubernetes.io/projected/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-kube-api-access-7xhfr\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fcfdac9-7588-48a3-bdc7-ee54713f0431-konnectivity-ca\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-iptables-alerter-script\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6hq8\" (UniqueName: \"kubernetes.io/projected/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-kube-api-access-k6hq8\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.286459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-ovn\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-log-socket\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-script-lib\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-modprobe-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-conf\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cfe87db-d6b5-424f-84ef-1143c76da5f5-serviceca\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-modprobe-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.285909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cni-binary-copy\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-multus\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-etc-kubernetes\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-daemon-config\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cnibin\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-cnibin\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.287471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-host\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-netns\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-hostroot\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-hostroot\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-registration-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-iptables-alerter-script\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-tuned\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-run-netns\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/892d7c90-3031-411c-a2ad-5d28859b21b2-registration-dir\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-etc-kubernetes\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53761cb1-df13-4c43-ae36-69c409c4aeae-tmp-dir\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-cni-multus\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-host\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-netd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286738    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-conf\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.288491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-os-release\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-kubelet\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwvx\" (UniqueName: \"kubernetes.io/projected/892d7c90-3031-411c-a2ad-5d28859b21b2-kube-api-access-pmwvx\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fcfdac9-7588-48a3-bdc7-ee54713f0431-agent-certs\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-os-release\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-systemd\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.286991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-slash\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cnibin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.287025    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-tmp\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmrz\" (UniqueName: \"kubernetes.io/projected/53761cb1-df13-4c43-ae36-69c409c4aeae-kube-api-access-5tmrz\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.287094    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:03:51.787071955 +0000 UTC m=+2.980850315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-host-var-lib-kubelet\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wksx5\" (UniqueName: \"kubernetes.io/projected/5cfe87db-d6b5-424f-84ef-1143c76da5f5-kube-api-access-wksx5\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.289531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-socket-dir-parent\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbs8\" (UniqueName: \"kubernetes.io/projected/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-kube-api-access-bnbs8\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-sysctl-d\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljfg\" (UniqueName: \"kubernetes.io/projected/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-kube-api-access-fljfg\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-bin\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-cnibin\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-conf-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-systemd\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287562    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-socket-dir-parent\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-multus-conf-dir\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.290293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.287664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.291025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.290821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-tmp\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.291025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.290872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-etc-tuned\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.291137 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.291034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fcfdac9-7588-48a3-bdc7-ee54713f0431-agent-certs\") pod \"konnectivity-agent-trcg4\" (UID: \"3fcfdac9-7588-48a3-bdc7-ee54713f0431\") " pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.291985 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.291948    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:03:51.291985 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.291969    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:03:51.291985 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.291984    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:51.292224 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.292041    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:51.792024908 +0000 UTC m=+2.985803273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:51.294805 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.294459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtwlq\" (UniqueName: \"kubernetes.io/projected/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-kube-api-access-jtwlq\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.295636 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.295543    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhfr\" (UniqueName: \"kubernetes.io/projected/3f2df684-bde4-4e4e-999a-0ca5e9f3f76f-kube-api-access-7xhfr\") pod \"multus-8zspx\" (UID: \"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f\") " pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.295877 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.295845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6hq8\" (UniqueName: \"kubernetes.io/projected/d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6-kube-api-access-k6hq8\") pod \"iptables-alerter-wcpr8\" (UID: \"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6\") " pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.297319 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.297293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwvx\" (UniqueName: \"kubernetes.io/projected/892d7c90-3031-411c-a2ad-5d28859b21b2-kube-api-access-pmwvx\") pod \"aws-ebs-csi-driver-node-q59zs\" (UID: \"892d7c90-3031-411c-a2ad-5d28859b21b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.297445 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.297423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbs8\" (UniqueName: \"kubernetes.io/projected/ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc-kube-api-access-bnbs8\") pod \"multus-additional-cni-plugins-xpp7h\" (UID: \"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc\") " pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.298197 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.298161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wksx5\" (UniqueName: \"kubernetes.io/projected/5cfe87db-d6b5-424f-84ef-1143c76da5f5-kube-api-access-wksx5\") pod \"node-ca-7gj2n\" (UID: \"5cfe87db-d6b5-424f-84ef-1143c76da5f5\") " pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.299402 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.299382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljfg\" (UniqueName: \"kubernetes.io/projected/42fa8f0a-99eb-4dbe-a3bf-5c64d884692c-kube-api-access-fljfg\") pod \"tuned-zkt8h\" (UID: \"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c\") " pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.387747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-slash\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmrz\" (UniqueName: \"kubernetes.io/projected/53761cb1-df13-4c43-ae36-69c409c4aeae-kube-api-access-5tmrz\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-bin\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-netns\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.387945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-dbus\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2j9\" (UniqueName: \"kubernetes.io/projected/d5c581f1-c084-4699-8fe7-ca240de9088a-kube-api-access-2m2j9\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-netns\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.387977    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-bin\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387977    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-dbus\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-etc-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.387855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-slash\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-etc-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.388031    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:51.888014557 +0000 UTC m=+3.081792922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-config\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53761cb1-df13-4c43-ae36-69c409c4aeae-hosts-file\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-kubelet-config\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-kubelet\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53761cb1-df13-4c43-ae36-69c409c4aeae-hosts-file\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.388411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048b905f-b8e5-4d6f-a055-7a9a4735d314-kubelet-config\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-kubelet\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-systemd-units\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-systemd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-var-lib-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-systemd-units\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-node-log\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-node-log\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-var-lib-openvswitch\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-systemd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-env-overrides\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5c581f1-c084-4699-8fe7-ca240de9088a-ovn-node-metrics-cert\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-ovn\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-log-socket\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-script-lib\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53761cb1-df13-4c43-ae36-69c409c4aeae-tmp-dir\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.389307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-config\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-netd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-host-cni-netd\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-run-ovn\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5c581f1-c084-4699-8fe7-ca240de9088a-log-socket\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.388817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-env-overrides\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.389079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53761cb1-df13-4c43-ae36-69c409c4aeae-tmp-dir\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.390503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.389232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5c581f1-c084-4699-8fe7-ca240de9088a-ovnkube-script-lib\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.392105 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.392079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5c581f1-c084-4699-8fe7-ca240de9088a-ovn-node-metrics-cert\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.400087 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.400063    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmrz\" (UniqueName: \"kubernetes.io/projected/53761cb1-df13-4c43-ae36-69c409c4aeae-kube-api-access-5tmrz\") pod \"node-resolver-dgxdm\" (UID: \"53761cb1-df13-4c43-ae36-69c409c4aeae\") " pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.400577 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.400552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2j9\" (UniqueName: \"kubernetes.io/projected/d5c581f1-c084-4699-8fe7-ca240de9088a-kube-api-access-2m2j9\") pod \"ovnkube-node-gbkl2\" (UID: \"d5c581f1-c084-4699-8fe7-ca240de9088a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.422310 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.422222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4ee66b5b05b527d148b1ad9fbf1afb99","Type":"ContainerStarted","Data":"d1b44747c5061ef34e95e7715e3195f6473ebbf31974757fca05aea636dc7813"}
Jul 27 20:03:51.423734 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.423707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" event={"ID":"18c11acd5cd8d4a73c3376324fc2305f","Type":"ContainerStarted","Data":"610515b1b7b2c7794b2ece15bca4ae85087c5d7d47b114058e1d916cfa5baaef"}
Jul 27 20:03:51.475429 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.475398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpp7h"
Jul 27 20:03:51.488728 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.488705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs"
Jul 27 20:03:51.497635 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.497612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcpr8"
Jul 27 20:03:51.504447 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.504430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:03:51.512256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.512234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkt8h"
Jul 27 20:03:51.521281 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.521229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7gj2n"
Jul 27 20:03:51.529208 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.529178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zspx"
Jul 27 20:03:51.537935 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.537917    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgxdm"
Jul 27 20:03:51.543967 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.543942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:03:51.790982 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.790914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:51.791124 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.791068    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:51.791162 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.791130    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:03:52.791113573 +0000 UTC m=+3.984891933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:51.892057 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.892021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:51.892267 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:51.892095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:51.892267 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892221    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:51.892267 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892251    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:03:51.892448 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892277    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:03:51.892448 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892282    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:52.892262744 +0000 UTC m=+4.086041118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:51.892448 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892291    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:51.892448 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:51.892349    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:52.892333108 +0000 UTC m=+4.086111472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:52.227684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.227562    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:58:51 +0000 UTC" deadline="2028-02-26 00:57:14.923773971 +0000 UTC"
Jul 27 20:03:52.227684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.227630    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13876h53m22.696147709s"
Jul 27 20:03:52.418462 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.418431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:52.418637 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.418543    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:03:52.478260 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.477878    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfe87db_d6b5_424f_84ef_1143c76da5f5.slice/crio-f0a4f7dad739564db2c709c77c5cafb8b19416c3bcaf5f534ab0c08060a5f9c1 WatchSource:0}: Error finding container f0a4f7dad739564db2c709c77c5cafb8b19416c3bcaf5f534ab0c08060a5f9c1: Status 404 returned error can't find the container with id f0a4f7dad739564db2c709c77c5cafb8b19416c3bcaf5f534ab0c08060a5f9c1
Jul 27 20:03:52.479949 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.479921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6be19e_92dc_4da1_bf4b_4f88e97fe8fc.slice/crio-c1f747666a5e88656a342a996a9fd1cd600347863e5d6b2f0547f195c3fd251f WatchSource:0}: Error finding container c1f747666a5e88656a342a996a9fd1cd600347863e5d6b2f0547f195c3fd251f: Status 404 returned error can't find the container with id c1f747666a5e88656a342a996a9fd1cd600347863e5d6b2f0547f195c3fd251f
Jul 27 20:03:52.483852 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.483812    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892d7c90_3031_411c_a2ad_5d28859b21b2.slice/crio-68e258517b8ec64680a32b30cce2c554c29442b610f3ea7e6cab6a01caadb887 WatchSource:0}: Error finding container 68e258517b8ec64680a32b30cce2c554c29442b610f3ea7e6cab6a01caadb887: Status 404 returned error can't find the container with id 68e258517b8ec64680a32b30cce2c554c29442b610f3ea7e6cab6a01caadb887
Jul 27 20:03:52.486789 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.486763    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2df684_bde4_4e4e_999a_0ca5e9f3f76f.slice/crio-0e8a3eff7515f9f9c20a5ff15833c3af3f67dcf6b848b36dbfd248dadd6fee10 WatchSource:0}: Error finding container 0e8a3eff7515f9f9c20a5ff15833c3af3f67dcf6b848b36dbfd248dadd6fee10: Status 404 returned error can't find the container with id 0e8a3eff7515f9f9c20a5ff15833c3af3f67dcf6b848b36dbfd248dadd6fee10
Jul 27 20:03:52.487758 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.487682    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c581f1_c084_4699_8fe7_ca240de9088a.slice/crio-e5c77d7f68f5c022c65382726f899f271c244e0102aa0bcb3c27e19ee60316ea WatchSource:0}: Error finding container e5c77d7f68f5c022c65382726f899f271c244e0102aa0bcb3c27e19ee60316ea: Status 404 returned error can't find the container with id e5c77d7f68f5c022c65382726f899f271c244e0102aa0bcb3c27e19ee60316ea
Jul 27 20:03:52.490496 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.490056    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fcfdac9_7588_48a3_bdc7_ee54713f0431.slice/crio-e1aaebf13081458e661f1b4b24a3bb2600d451c8a5de359cf731711ea103528d WatchSource:0}: Error finding container e1aaebf13081458e661f1b4b24a3bb2600d451c8a5de359cf731711ea103528d: Status 404 returned error can't find the container with id e1aaebf13081458e661f1b4b24a3bb2600d451c8a5de359cf731711ea103528d
Jul 27 20:03:52.491501 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.490989    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64ea2f8_2c89_4abf_80ee_c7cc8795bbb6.slice/crio-4c3c51f69fb46dbd29edb12d630b02342ed2c938eb12a13bc22cd96f5dbc9db8 WatchSource:0}: Error finding container 4c3c51f69fb46dbd29edb12d630b02342ed2c938eb12a13bc22cd96f5dbc9db8: Status 404 returned error can't find the container with id 4c3c51f69fb46dbd29edb12d630b02342ed2c938eb12a13bc22cd96f5dbc9db8
Jul 27 20:03:52.492395 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.492163    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53761cb1_df13_4c43_ae36_69c409c4aeae.slice/crio-2e790623abd9d15d42b29bc8d3ce8957084e62a85d9a9f411cc2da1f3b45f413 WatchSource:0}: Error finding container 2e790623abd9d15d42b29bc8d3ce8957084e62a85d9a9f411cc2da1f3b45f413: Status 404 returned error can't find the container with id 2e790623abd9d15d42b29bc8d3ce8957084e62a85d9a9f411cc2da1f3b45f413
Jul 27 20:03:52.494539 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:03:52.494518    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fa8f0a_99eb_4dbe_a3bf_5c64d884692c.slice/crio-39ad40f2f1c759a6f34b6f8f89de3b0006201a45a960910846cf0afe5e230607 WatchSource:0}: Error finding container 39ad40f2f1c759a6f34b6f8f89de3b0006201a45a960910846cf0afe5e230607: Status 404 returned error can't find the container with id 39ad40f2f1c759a6f34b6f8f89de3b0006201a45a960910846cf0afe5e230607
Jul 27 20:03:52.799758 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.799460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:52.799758 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.799609    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:52.799947 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.799791    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:03:54.799772832 +0000 UTC m=+5.993551196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:52.900498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.900465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:52.900667 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900641    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:03:52.900736 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900670    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:03:52.900736 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900684    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:52.900736 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900719    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:52.900869 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900742    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:54.900723034 +0000 UTC m=+6.094501404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:52.900869 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:52.900765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:54.900752393 +0000 UTC m=+6.094530760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:52.900869 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:52.900637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:53.228275 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.228162    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:58:51 +0000 UTC" deadline="2028-04-01 02:32:17.461519345 +0000 UTC"
Jul 27 20:03:53.228275 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.228205    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14718h28m24.233318969s"
Jul 27 20:03:53.419643 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.419602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:53.419819 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:53.419727    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:03:53.420370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.420342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:53.420487 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:53.420456    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:03:53.448870 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.448137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" event={"ID":"18c11acd5cd8d4a73c3376324fc2305f","Type":"ContainerStarted","Data":"95c1bf9cc0c3c7765eaf76fb0628fe2ca054527030622c9bb9075451ae30b74a"}
Jul 27 20:03:53.457272 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.455370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgxdm" event={"ID":"53761cb1-df13-4c43-ae36-69c409c4aeae","Type":"ContainerStarted","Data":"2e790623abd9d15d42b29bc8d3ce8957084e62a85d9a9f411cc2da1f3b45f413"}
Jul 27 20:03:53.463899 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.463727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcpr8" event={"ID":"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6","Type":"ContainerStarted","Data":"4c3c51f69fb46dbd29edb12d630b02342ed2c938eb12a13bc22cd96f5dbc9db8"}
Jul 27 20:03:53.464431 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.464376    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" podStartSLOduration=2.464358554 podStartE2EDuration="2.464358554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:03:53.464332392 +0000 UTC m=+4.658110795" watchObservedRunningTime="2026-07-27 20:03:53.464358554 +0000 UTC m=+4.658136939"
Jul 27 20:03:53.469543 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.469457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trcg4" event={"ID":"3fcfdac9-7588-48a3-bdc7-ee54713f0431","Type":"ContainerStarted","Data":"e1aaebf13081458e661f1b4b24a3bb2600d451c8a5de359cf731711ea103528d"}
Jul 27 20:03:53.475301 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.475225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkt8h" event={"ID":"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c","Type":"ContainerStarted","Data":"39ad40f2f1c759a6f34b6f8f89de3b0006201a45a960910846cf0afe5e230607"}
Jul 27 20:03:53.478543 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.478479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs" event={"ID":"892d7c90-3031-411c-a2ad-5d28859b21b2","Type":"ContainerStarted","Data":"68e258517b8ec64680a32b30cce2c554c29442b610f3ea7e6cab6a01caadb887"}
Jul 27 20:03:53.487007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.486980    2575 generic.go:356] "Generic (PLEG): container finished" podID="4ee66b5b05b527d148b1ad9fbf1afb99" containerID="3b2bcad77a5a2845e76a1c9e7d78c4fe57843192e90fc2f14f0f3e67c3382285" exitCode=0
Jul 27 20:03:53.487100 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.487054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4ee66b5b05b527d148b1ad9fbf1afb99","Type":"ContainerDied","Data":"3b2bcad77a5a2845e76a1c9e7d78c4fe57843192e90fc2f14f0f3e67c3382285"}
Jul 27 20:03:53.497804 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.497570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"e5c77d7f68f5c022c65382726f899f271c244e0102aa0bcb3c27e19ee60316ea"}
Jul 27 20:03:53.500217 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.500130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zspx" event={"ID":"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f","Type":"ContainerStarted","Data":"0e8a3eff7515f9f9c20a5ff15833c3af3f67dcf6b848b36dbfd248dadd6fee10"}
Jul 27 20:03:53.525776 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.525739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerStarted","Data":"c1f747666a5e88656a342a996a9fd1cd600347863e5d6b2f0547f195c3fd251f"}
Jul 27 20:03:53.537863 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:53.535540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7gj2n" event={"ID":"5cfe87db-d6b5-424f-84ef-1143c76da5f5","Type":"ContainerStarted","Data":"f0a4f7dad739564db2c709c77c5cafb8b19416c3bcaf5f534ab0c08060a5f9c1"}
Jul 27 20:03:54.418600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:54.418053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:54.418600 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.418197    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:03:54.554347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:54.554234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4ee66b5b05b527d148b1ad9fbf1afb99","Type":"ContainerStarted","Data":"ee0e249e20da0dbf95a02ade6b74e0d1909ab03a30e1d262da475247013f546a"}
Jul 27 20:03:54.821434 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:54.821346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:54.821609 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.821551    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:54.821692 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.821621    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:03:58.821600449 +0000 UTC m=+10.015378816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:54.922505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:54.922591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.922750    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.922770    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.922784    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.922848    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:58.922827852 +0000 UTC m=+10.116606220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.923082    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:54.923188 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:54.923156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:58.92313738 +0000 UTC m=+10.116915744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:55.421089 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:55.421053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:55.421605 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:55.421203    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:03:55.421674 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:55.421652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:55.421908 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:55.421751    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:03:56.418503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:56.418455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:56.418711 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:56.418610    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:03:57.419241 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:57.418262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:57.419241 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:57.418400    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:03:57.419241 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:57.418801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:57.419241 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:57.418908    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:03:58.418712 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:58.418617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:58.418883 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.418773    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:03:58.856499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:58.856389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:03:58.856971 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.856553    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:58.856971 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.856659    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:04:06.856634405 +0000 UTC m=+18.050412820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:03:58.957187 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:58.957144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:58.957389 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:58.957252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:58.957389 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957303    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:03:58.957389 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957324    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:03:58.957389 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957341    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:58.957389 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957359    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:58.957687 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957408    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:06.957388489 +0000 UTC m=+18.151166859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:03:58.957687 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:58.957429    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:06.95742158 +0000 UTC m=+18.151199940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:03:59.421539 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:59.421501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:03:59.421727 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:59.421664    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:03:59.421963 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:03:59.421936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:03:59.422125 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:03:59.422098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:00.418409 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:00.418361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:00.418885 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:00.418503    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:01.418622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:01.418587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:01.418622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:01.418634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:01.419149 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:01.418716    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:01.419149 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:01.418822    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:02.418816 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:02.418784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:02.419224 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:02.418897    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:03.417815 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:03.417781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:03.417987 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:03.417916    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:03.418311 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:03.418290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:03.418411 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:03.418390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:04.418569 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:04.418536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:04.418978 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:04.418661    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:05.418624 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:05.418586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:05.419046 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:05.418722    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:05.419046 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:05.418784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:05.419046 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:05.418871    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:06.418451 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:06.418418    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:06.418736 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:06.418556    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:06.919619 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:06.919590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:06.919812 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:06.919763    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:06.919934 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:06.919839    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:04:22.919818528 +0000 UTC m=+34.113596891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:07.020423 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:07.020389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:07.020589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:07.020447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:07.020589 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020541    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:07.020589 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020568    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:07.020589 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020584    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:07.020713 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020596    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:07.020713 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020610    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:23.020592304 +0000 UTC m=+34.214370683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:07.020713 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.020630    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:23.020620699 +0000 UTC m=+34.214399058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:07.418641 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:07.418608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:07.418797 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:07.418619    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:07.418797 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.418731    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:07.419128 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:07.418807    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:08.418610 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:08.418573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:08.418839 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:08.418705    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:09.418884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:09.418848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:09.419351 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:09.418952    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:09.419351 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:09.419051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:09.419351 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:09.419156    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:10.417917 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:10.417883    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:10.418103 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:10.417999    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:11.418147 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.417858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:11.418926 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.417876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:11.418926 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:11.418252    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:11.418926 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:11.418329    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:11.591228 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.591197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trcg4" event={"ID":"3fcfdac9-7588-48a3-bdc7-ee54713f0431","Type":"ContainerStarted","Data":"ce09923eadc4bd44264a674cd8cdb3158628fa092f5cb289690904af427bf6ac"}
Jul 27 20:04:11.592484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.592461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkt8h" event={"ID":"42fa8f0a-99eb-4dbe-a3bf-5c64d884692c","Type":"ContainerStarted","Data":"f89116235a77b2ab90493d3a16d338e5f50fa3d5bf307af31e332b56b3af7c31"}
Jul 27 20:04:11.593884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.593859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs" event={"ID":"892d7c90-3031-411c-a2ad-5d28859b21b2","Type":"ContainerStarted","Data":"239c17ea2aae3eba3589ab66ee1e8bcaa9772ffb02a5129f942dd1e15b85cbe9"}
Jul 27 20:04:11.596531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.596491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"1cc9ff57a8cfc3ff1ab77040c0eccf21f24e896a1356c10924e72cdbd92ab98c"}
Jul 27 20:04:11.596625 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.596545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"f64121a14bffd74128635cb71083af0974f9ee9645182b60f879aa8b44890ab0"}
Jul 27 20:04:11.596625 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.596575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"fa676926784fee6cb886dce532381632885bae731940cdad045cf277011d618b"}
Jul 27 20:04:11.596625 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.596607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"0ebaa423100c57414acf6f3d40bd44f346704ad6201a8b58213d29a8a997b2b7"}
Jul 27 20:04:11.596793 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.596632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"38db59e46ab33beaef2d48595393404eeefbe24c9f0d86f1df27e444c2631bf0"}
Jul 27 20:04:11.597934 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.597907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zspx" event={"ID":"3f2df684-bde4-4e4e-999a-0ca5e9f3f76f","Type":"ContainerStarted","Data":"d0dc50afd42f3a5e08b33e925e01d33dd628e87eb840bfa45cfeb3ffeaf716f3"}
Jul 27 20:04:11.599421 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.599399    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="19db1b4f96790dd8e9e239b3bc8c7063dfd026b736540822c9e3823bc1ce5e26" exitCode=0
Jul 27 20:04:11.599513 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.599480    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"19db1b4f96790dd8e9e239b3bc8c7063dfd026b736540822c9e3823bc1ce5e26"}
Jul 27 20:04:11.600953 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.600932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7gj2n" event={"ID":"5cfe87db-d6b5-424f-84ef-1143c76da5f5","Type":"ContainerStarted","Data":"c295630216a3d87b4fa0c4b7d3072fb453c2d02ced3eb99b053cd5c9d2b1776c"}
Jul 27 20:04:11.602296 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.602278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgxdm" event={"ID":"53761cb1-df13-4c43-ae36-69c409c4aeae","Type":"ContainerStarted","Data":"7900ac724b069616d82bacde67f8a6b80f2511acaff05f18372b4b1f2cf7ace8"}
Jul 27 20:04:11.607911 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.607873    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-trcg4" podStartSLOduration=3.097670038 podStartE2EDuration="21.60786245s" totalImagesPullingTime="18.510192412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:11.607391352 +0000 UTC m=+22.801169733" watchObservedRunningTime="2026-07-27 20:04:11.60786245 +0000 UTC m=+22.801640831"
Jul 27 20:04:11.608006 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.607987    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" podStartSLOduration=20.607982309 podStartE2EDuration="20.607982309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:03:54.569958259 +0000 UTC m=+5.763736644" watchObservedRunningTime="2026-07-27 20:04:11.607982309 +0000 UTC m=+22.801760690"
Jul 27 20:04:11.639593 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.639552    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zkt8h" podStartSLOduration=3.134301465 podStartE2EDuration="21.639536012s" totalImagesPullingTime="18.505234547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:11.639137493 +0000 UTC m=+22.832915886" watchObservedRunningTime="2026-07-27 20:04:11.639536012 +0000 UTC m=+22.833314390"
Jul 27 20:04:11.653144 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.653101    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8zspx" podStartSLOduration=3.082177647 podStartE2EDuration="21.653086457s" totalImagesPullingTime="18.57090881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:11.65298276 +0000 UTC m=+22.846761141" watchObservedRunningTime="2026-07-27 20:04:11.653086457 +0000 UTC m=+22.846864837"
Jul 27 20:04:11.670744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.670702    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7gj2n" podStartSLOduration=3.147398918 podStartE2EDuration="21.670688977s" totalImagesPullingTime="18.523290059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:11.67066472 +0000 UTC m=+22.864443102" watchObservedRunningTime="2026-07-27 20:04:11.670688977 +0000 UTC m=+22.864467355"
Jul 27 20:04:11.693472 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:11.693430    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgxdm" podStartSLOduration=3.17871478 podStartE2EDuration="21.693414302s" totalImagesPullingTime="18.514699522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:11.692939502 +0000 UTC m=+22.886717881" watchObservedRunningTime="2026-07-27 20:04:11.693414302 +0000 UTC m=+22.887192682"
Jul 27 20:04:12.418221 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.418189    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:12.418628 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:12.418342    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:12.524139 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.524117    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:04:12.607980 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.607944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"e2e9168b7790a8a4c1eea2f2cc7010c1053460f06a5d5f8a68975ce9c0228bf4"}
Jul 27 20:04:12.609492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.609463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcpr8" event={"ID":"d64ea2f8-2c89-4abf-80ee-c7cc8795bbb6","Type":"ContainerStarted","Data":"5875ab4cce9ed2fc54238af9b4aab6c02eb5e5b0e70f0907064b06560ef3cb20"}
Jul 27 20:04:12.611559 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.611496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs" event={"ID":"892d7c90-3031-411c-a2ad-5d28859b21b2","Type":"ContainerStarted","Data":"5ae61398835b0e8191c47e4c38a571d7f20e2d64edb7eae2d95c36d970710dfe"}
Jul 27 20:04:12.613598 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.613574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:04:12.637697 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:12.637622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wcpr8" podStartSLOduration=4.128722764 podStartE2EDuration="22.637611153s" totalImagesPullingTime="18.508888389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:12.637304309 +0000 UTC m=+23.831082690" watchObservedRunningTime="2026-07-27 20:04:12.637611153 +0000 UTC m=+23.831389533"
Jul 27 20:04:13.418047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:13.418015    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:13.418047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:13.418044    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:13.418761 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:13.418145    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:13.418761 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:13.418290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:13.425150 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:13.425058    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:04:12.524134005Z","UUID":"d6e09b94-fb72-4c44-b9ef-bb8c4309618c","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:04:13.426669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:13.426650    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:04:13.426864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:13.426688    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:04:14.418683 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:14.418650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:14.419112 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:14.418798    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:14.618333 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:14.618294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs" event={"ID":"892d7c90-3031-411c-a2ad-5d28859b21b2","Type":"ContainerStarted","Data":"2f94595413d9bd9bfac7993eb12db76291e1ab0159ee0494b5143c05be4e373d"}
Jul 27 20:04:14.622117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:14.622084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"1bd834622236018340d9139a6033dbe750fcb0922988e9011675292fc35fbe37"}
Jul 27 20:04:14.639720 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:14.639671    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q59zs" podStartSLOduration=3.954955447 podStartE2EDuration="24.639655977s" totalImagesPullingTime="20.68470053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:14.639149736 +0000 UTC m=+25.832928121" watchObservedRunningTime="2026-07-27 20:04:14.639655977 +0000 UTC m=+25.833434358"
Jul 27 20:04:15.418361 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:15.418133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:15.418544 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:15.418169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:15.418544 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:15.418471    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:15.418544 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:15.418530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:15.912936 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:15.912872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:04:15.913490 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:15.913469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:04:16.417931 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.417865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:16.418061 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:16.417966    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:16.627419 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.627383    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="9b9b1f9e892b167e1139fc92a005ede549144f87e69c8b51949656bfb162ef61" exitCode=0
Jul 27 20:04:16.627594 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.627465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"9b9b1f9e892b167e1139fc92a005ede549144f87e69c8b51949656bfb162ef61"}
Jul 27 20:04:16.631351 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.631309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" event={"ID":"d5c581f1-c084-4699-8fe7-ca240de9088a","Type":"ContainerStarted","Data":"52b09d3fc5f88cbb4395117a970895928b298dc6ccab4e09a01209f033f5731d"}
Jul 27 20:04:16.631947 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.631932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-trcg4"
Jul 27 20:04:16.693761 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:16.693689    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2" podStartSLOduration=8.116206073 podStartE2EDuration="26.693676738s" totalImagesPullingTime="18.577470665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:16.693425464 +0000 UTC m=+27.887203845" watchObservedRunningTime="2026-07-27 20:04:16.693676738 +0000 UTC m=+27.887455116"
Jul 27 20:04:17.418147 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.418116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:17.418891 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:17.418259    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:17.418891 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.418377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:17.418891 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:17.418495    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:17.634816 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.634600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:17.634975 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.634871    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:17.634975 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.634921    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:17.649657 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.649630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:17.649819 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:17.649809    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:18.266786 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.266733    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqggf"]
Jul 27 20:04:18.266951 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.266908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:18.267034 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:18.267003    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:18.267584 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.267562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jlwcv"]
Jul 27 20:04:18.267664 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.267649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:18.267736 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:18.267718    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:18.279148 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.279128    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xzfv"]
Jul 27 20:04:18.279243 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.279217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:18.279311 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:18.279274    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:18.638378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.638297    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="30276e2e46dd19a2a768d7bd4d5dafc8ab8aa024ddd7946e3354f6303d1ad723" exitCode=0
Jul 27 20:04:18.638717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:18.638370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"30276e2e46dd19a2a768d7bd4d5dafc8ab8aa024ddd7946e3354f6303d1ad723"}
Jul 27 20:04:19.419717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:19.419683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:19.419876 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:19.419792    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:19.419876 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:19.419838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:19.419954 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:19.419936    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:20.418799 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:20.418723    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:20.419140 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:20.418822    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:20.645036 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:20.645003    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="bcf78fb04c10a93ed2718ccab24039bfa30f72513153af750fd8aa8a5e3e9142" exitCode=0
Jul 27 20:04:20.645194 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:20.645051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"bcf78fb04c10a93ed2718ccab24039bfa30f72513153af750fd8aa8a5e3e9142"}
Jul 27 20:04:21.418718 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:21.418525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:21.418907 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:21.418525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:21.418907 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:21.418799    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:21.419315 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:21.418925    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:22.418360 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:22.418324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:22.418530 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:22.418454    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:22.934602 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:22.934567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:22.934984 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:22.934685    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:22.934984 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:22.934741    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:04:54.934725478 +0000 UTC m=+66.128503837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:23.035338 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:23.035244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:23.035509 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:23.035338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:23.035509 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035441    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:23.035509 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035463    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:23.035620 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035521    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret podName:048b905f-b8e5-4d6f-a055-7a9a4735d314 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:55.035504521 +0000 UTC m=+66.229282884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret") pod "global-pull-secret-syncer-wqggf" (UID: "048b905f-b8e5-4d6f-a055-7a9a4735d314") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:23.035620 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035466    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:23.035620 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035556    2575 projected.go:196] Error preparing data for projected volume kube-api-access-8vmgt for pod openshift-network-diagnostics/network-check-target-9xzfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:23.035620 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.035609    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt podName:5c6c1429-49bb-479a-b581-9107fb8bf832 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:55.03559339 +0000 UTC m=+66.229371749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vmgt" (UniqueName: "kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt") pod "network-check-target-9xzfv" (UID: "5c6c1429-49bb-479a-b581-9107fb8bf832") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:23.418266 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:23.418169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:23.418405 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.418331    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqggf" podUID="048b905f-b8e5-4d6f-a055-7a9a4735d314"
Jul 27 20:04:23.418405 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:23.418387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:23.418527 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:23.418502    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xzfv" podUID="5c6c1429-49bb-479a-b581-9107fb8bf832"
Jul 27 20:04:24.418231 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.418195    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:24.418743 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.418333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlwcv" podUID="1a332b09-8a59-4f57-ba41-c0bbb27b67ae"
Jul 27 20:04:24.580618 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.580591    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeReady"
Jul 27 20:04:24.580781 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.580725    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:04:24.616141 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.616100    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"]
Jul 27 20:04:24.619364 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.619333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.620105 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.620082    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-777bf47b9-x5pc8"]
Jul 27 20:04:24.621992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.621971    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 20:04:24.622354 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.622336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 20:04:24.622354 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.622350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rkd48\""
Jul 27 20:04:24.622475 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.622350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 20:04:24.622721 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.622707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"]
Jul 27 20:04:24.622844 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.622831    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.625249 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.625206    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:04:24.625249 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.625221    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"]
Jul 27 20:04:24.625481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.625407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:04:24.625575 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.625520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.625575 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.625551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:04:24.626264 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.626238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bsfqh\""
Jul 27 20:04:24.627876 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.627858    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 20:04:24.628192 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.628156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.629121 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.629099    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"]
Jul 27 20:04:24.631218 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.631199    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:04:24.631791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.631769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 20:04:24.631908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.631771    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 20:04:24.632415 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.632400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 20:04:24.632475 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.632401    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 20:04:24.633985 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.633964    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"]
Jul 27 20:04:24.641768 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.641738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777bf47b9-x5pc8"]
Jul 27 20:04:24.642561 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.642539    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26s9d"]
Jul 27 20:04:24.643895 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.643875    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 20:04:24.645888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.645868    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gxh9r"]
Jul 27 20:04:24.645989 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.645975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.648224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.648203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:04:24.648224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.648216    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:04:24.648347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.648238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k4bq\""
Jul 27 20:04:24.648828 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.648810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.651019 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.650996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"]
Jul 27 20:04:24.652397 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.652377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:04:24.652493 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.652436    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:04:24.652552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.652388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dk9cc\""
Jul 27 20:04:24.652620 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.652602    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:04:24.655347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.655156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxh9r"]
Jul 27 20:04:24.658216 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.658143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26s9d"]
Jul 27 20:04:24.749197 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqrd\" (UniqueName: \"kubernetes.io/projected/20cbf953-46ee-4c3a-951d-52b0a272b6b3-kube-api-access-vlqrd\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.749342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zt5z\" (UniqueName: \"kubernetes.io/projected/4c527137-d828-4b89-8b50-83c920bd7fe3-kube-api-access-8zt5z\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.749342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqx8\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmdr\" (UniqueName: \"kubernetes.io/projected/63b0cb65-e316-4bed-8c39-04e143a16fca-kube-api-access-hxmdr\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnwp\" (UniqueName: \"kubernetes.io/projected/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-kube-api-access-fmnwp\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c527137-d828-4b89-8b50-83c920bd7fe3-tmp\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-config-volume\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4d6x\" (UniqueName: \"kubernetes.io/projected/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-kube-api-access-l4d6x\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20cbf953-46ee-4c3a-951d-52b0a272b6b3-cert\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-tmp-dir\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4c527137-d828-4b89-8b50-83c920bd7fe3-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63b0cb65-e316-4bed-8c39-04e143a16fca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.749918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.749888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.853217 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.853339 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zt5z\" (UniqueName: \"kubernetes.io/projected/4c527137-d828-4b89-8b50-83c920bd7fe3-kube-api-access-8zt5z\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.853339 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.853439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.853439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqx8\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.853439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.853585 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmdr\" (UniqueName: \"kubernetes.io/projected/63b0cb65-e316-4bed-8c39-04e143a16fca-kube-api-access-hxmdr\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.853810 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnwp\" (UniqueName: \"kubernetes.io/projected/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-kube-api-access-fmnwp\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.853810 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c527137-d828-4b89-8b50-83c920bd7fe3-tmp\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.853810 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-config-volume\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.854011 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853937    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854011 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.853993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4d6x\" (UniqueName: \"kubernetes.io/projected/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-kube-api-access-l4d6x\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.854112 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.854112 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854112 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c527137-d828-4b89-8b50-83c920bd7fe3-tmp\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.854112 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20cbf953-46ee-4c3a-951d-52b0a272b6b3-cert\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-tmp-dir\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4c527137-d828-4b89-8b50-83c920bd7fe3-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63b0cb65-e316-4bed-8c39-04e143a16fca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.854350 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.854780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqrd\" (UniqueName: \"kubernetes.io/projected/20cbf953-46ee-4c3a-951d-52b0a272b6b3-kube-api-access-vlqrd\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.854780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-config-volume\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.854780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.854982 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.854855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-tmp-dir\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.855821 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.855122    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:24.855821 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.855219    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:25.355199441 +0000 UTC m=+36.548977817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:24.856017 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.855994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.858625 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.858202    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.858625 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.858531    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:24.858625 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.858546    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:24.858625 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:24.858598    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:25.358579344 +0000 UTC m=+36.552357709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:24.858961 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.858727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-ca\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.858961 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.858727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.858961 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.858952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.859114 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.859075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4c527137-d828-4b89-8b50-83c920bd7fe3-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.859669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.859259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.859669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.859514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.859669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.859633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20cbf953-46ee-4c3a-951d-52b0a272b6b3-cert\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.860296 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.860278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-hub\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.860960 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.860940    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63b0cb65-e316-4bed-8c39-04e143a16fca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.865576 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.865555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zt5z\" (UniqueName: \"kubernetes.io/projected/4c527137-d828-4b89-8b50-83c920bd7fe3-kube-api-access-8zt5z\") pod \"klusterlet-addon-workmgr-dd8d7b56-pdz8c\" (UID: \"4c527137-d828-4b89-8b50-83c920bd7fe3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.867425 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.867400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnwp\" (UniqueName: \"kubernetes.io/projected/66fba0e4-fa0f-44ae-887a-2fb4b6152abb-kube-api-access-fmnwp\") pod \"cluster-proxy-proxy-agent-5456dcbd8d-7rx92\" (UID: \"66fba0e4-fa0f-44ae-887a-2fb4b6152abb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.867595 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.867574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqrd\" (UniqueName: \"kubernetes.io/projected/20cbf953-46ee-4c3a-951d-52b0a272b6b3-kube-api-access-vlqrd\") pod \"ingress-canary-gxh9r\" (UID: \"20cbf953-46ee-4c3a-951d-52b0a272b6b3\") " pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:24.867661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.867640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmdr\" (UniqueName: \"kubernetes.io/projected/63b0cb65-e316-4bed-8c39-04e143a16fca-kube-api-access-hxmdr\") pod \"managed-serviceaccount-addon-agent-575cffd9c4-754jt\" (UID: \"63b0cb65-e316-4bed-8c39-04e143a16fca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.867917 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.867894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqx8\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.868536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.868519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:24.868866 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.868851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4d6x\" (UniqueName: \"kubernetes.io/projected/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-kube-api-access-l4d6x\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:24.941016 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.940935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"
Jul 27 20:04:24.957606 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.957581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:04:24.979587 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.979558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:24.993328 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:24.993303    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxh9r"
Jul 27 20:04:25.106149 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.105565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt"]
Jul 27 20:04:25.110011 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:25.109970    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63b0cb65_e316_4bed_8c39_04e143a16fca.slice/crio-325a78b927afd674692a4acff5628d49c926a181593d7f799d1f37cc6261e7ee WatchSource:0}: Error finding container 325a78b927afd674692a4acff5628d49c926a181593d7f799d1f37cc6261e7ee: Status 404 returned error can't find the container with id 325a78b927afd674692a4acff5628d49c926a181593d7f799d1f37cc6261e7ee
Jul 27 20:04:25.118319 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.118293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"]
Jul 27 20:04:25.121018 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:25.120992    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66fba0e4_fa0f_44ae_887a_2fb4b6152abb.slice/crio-e4557f09b9f50ec9eb0b8b15f252db50505c100260d83a440d5c52fececcbe1c WatchSource:0}: Error finding container e4557f09b9f50ec9eb0b8b15f252db50505c100260d83a440d5c52fececcbe1c: Status 404 returned error can't find the container with id e4557f09b9f50ec9eb0b8b15f252db50505c100260d83a440d5c52fececcbe1c
Jul 27 20:04:25.141719 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.141664    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"]
Jul 27 20:04:25.144032 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:25.144013    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c527137_d828_4b89_8b50_83c920bd7fe3.slice/crio-f2959cc5d3c3430e17d866c55a2cd89b046e26fe413fb8a21c4b91241c830c86 WatchSource:0}: Error finding container f2959cc5d3c3430e17d866c55a2cd89b046e26fe413fb8a21c4b91241c830c86: Status 404 returned error can't find the container with id f2959cc5d3c3430e17d866c55a2cd89b046e26fe413fb8a21c4b91241c830c86
Jul 27 20:04:25.156430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.156407    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxh9r"]
Jul 27 20:04:25.158729 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:25.158710    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20cbf953_46ee_4c3a_951d_52b0a272b6b3.slice/crio-f5eefbc0c43eaf799679aecc52b8a90b7b969238b0223810bf4f33e80f2c3c57 WatchSource:0}: Error finding container f5eefbc0c43eaf799679aecc52b8a90b7b969238b0223810bf4f33e80f2c3c57: Status 404 returned error can't find the container with id f5eefbc0c43eaf799679aecc52b8a90b7b969238b0223810bf4f33e80f2c3c57
Jul 27 20:04:25.359831 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.359733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:25.359831 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.359768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:25.360010 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:25.359872    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:25.360010 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:25.359876    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:25.360010 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:25.359946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:26.359927615 +0000 UTC m=+37.553705973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:25.360010 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:25.359882    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:25.360010 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:25.360001    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:26.35998919 +0000 UTC m=+37.553767549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:25.417978 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.417943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:25.418167 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.418146    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:25.421988 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.421956    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:04:25.422664 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.422116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkj9h\""
Jul 27 20:04:25.422664 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.422274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:04:25.422664 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.422538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:04:25.659946 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.659859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxh9r" event={"ID":"20cbf953-46ee-4c3a-951d-52b0a272b6b3","Type":"ContainerStarted","Data":"f5eefbc0c43eaf799679aecc52b8a90b7b969238b0223810bf4f33e80f2c3c57"}
Jul 27 20:04:25.661987 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.661925    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c" event={"ID":"4c527137-d828-4b89-8b50-83c920bd7fe3","Type":"ContainerStarted","Data":"f2959cc5d3c3430e17d866c55a2cd89b046e26fe413fb8a21c4b91241c830c86"}
Jul 27 20:04:25.665492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.665346    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="9df51f9c0ac4bcdf0ab9c24045bb9ec0c173e02ae4f0b5a52e65f12f8c368c29" exitCode=0
Jul 27 20:04:25.665492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.665429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"9df51f9c0ac4bcdf0ab9c24045bb9ec0c173e02ae4f0b5a52e65f12f8c368c29"}
Jul 27 20:04:25.666918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.666896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt" event={"ID":"63b0cb65-e316-4bed-8c39-04e143a16fca","Type":"ContainerStarted","Data":"325a78b927afd674692a4acff5628d49c926a181593d7f799d1f37cc6261e7ee"}
Jul 27 20:04:25.668368 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:25.668276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerStarted","Data":"e4557f09b9f50ec9eb0b8b15f252db50505c100260d83a440d5c52fececcbe1c"}
Jul 27 20:04:26.371812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.371764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:26.372008 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.371827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:26.372082 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:26.372030    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:26.372082 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:26.372045    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:26.372207 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:26.372105    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:28.372086345 +0000 UTC m=+39.565864729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:26.372641 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:26.372622    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:26.372734 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:26.372677    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:28.372661095 +0000 UTC m=+39.566439454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:26.418757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.418723    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:26.424875 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.422770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hkrg\""
Jul 27 20:04:26.424875 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.423013    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:04:26.680869 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.680534    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc" containerID="9fb365439d3653aca2ff87e80b3c3d3db7d6d71ba0d8d3987fcdb8bb8622fdba" exitCode=0
Jul 27 20:04:26.680869 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:26.680595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerDied","Data":"9fb365439d3653aca2ff87e80b3c3d3db7d6d71ba0d8d3987fcdb8bb8622fdba"}
Jul 27 20:04:27.690243 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:27.689591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" event={"ID":"ef6be19e-92dc-4da1-bf4b-4f88e97fe8fc","Type":"ContainerStarted","Data":"74f51597aca12363f69a90d889868f42ba92f60284270d88b2cf3cafa7ee1241"}
Jul 27 20:04:27.717469 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:27.717187    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xpp7h" podStartSLOduration=8.649974165 podStartE2EDuration="37.717155094s" totalImagesPullingTime="29.067180929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:27.714757812 +0000 UTC m=+38.908536192" watchObservedRunningTime="2026-07-27 20:04:27.717155094 +0000 UTC m=+38.910933481"
Jul 27 20:04:28.392260 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:28.392097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:28.392260 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:28.392158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:28.392529 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:28.392281    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:28.392529 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:28.392329    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:28.392529 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:28.392347    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:28.392529 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:28.392379    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:32.392334523 +0000 UTC m=+43.586112887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:28.392529 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:28.392400    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:32.392390104 +0000 UTC m=+43.586168462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:32.428837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:32.428794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:32.428837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:32.428840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:32.429352 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:32.428945    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:32.429352 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:32.428956    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:32.429352 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:32.428956    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:32.429352 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:32.429031    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:40.428993756 +0000 UTC m=+51.622772114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:32.429352 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:32.429045    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:40.429038143 +0000 UTC m=+51.622816501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:33.707815 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.707782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerStarted","Data":"05f16aa2fbfcb64e41d84a876a15a7377ae69321165ec8bfed6ecb2c1bd3d53e"}
Jul 27 20:04:33.708279 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.707831    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerStarted","Data":"13608541372f85c19e15bd4dcd6c36fd27503ba3ea2450ecefc660c751883333"}
Jul 27 20:04:33.708279 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.707850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerStarted","Data":"c579d240bb68d0a5589622ba9c0f3e88074f59ef42b4cd1bd6e45d8eeb1a6a36"}
Jul 27 20:04:33.709159 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.709138    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxh9r" event={"ID":"20cbf953-46ee-4c3a-951d-52b0a272b6b3","Type":"ContainerStarted","Data":"8facc6cbdb42207ea1e67147eaa692d1b85b1521d92509ff8ce36409864000d5"}
Jul 27 20:04:33.710594 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.710571    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c" event={"ID":"4c527137-d828-4b89-8b50-83c920bd7fe3","Type":"ContainerStarted","Data":"c5ba5f96f4098df334ac6cdb634d3182320d4528e6b386c231f0655c7dca2271"}
Jul 27 20:04:33.710716 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.710699    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:33.712099 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.712076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt" event={"ID":"63b0cb65-e316-4bed-8c39-04e143a16fca","Type":"ContainerStarted","Data":"02be096ab616d8abf66835bf8de99edcd644fa5db73e564f2194a4fb4c23bfaf"}
Jul 27 20:04:33.712665 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.712649    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c"
Jul 27 20:04:33.734375 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.734317    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" podStartSLOduration=9.042962079 podStartE2EDuration="16.7343018s" totalImagesPullingTime="7.691339721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:33.729271354 +0000 UTC m=+44.923049736" watchObservedRunningTime="2026-07-27 20:04:33.7343018 +0000 UTC m=+44.928080308"
Jul 27 20:04:33.746440 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.746391    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-575cffd9c4-754jt" podStartSLOduration=9.062389794 podStartE2EDuration="16.746376476s" totalImagesPullingTime="7.683986682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:33.746019494 +0000 UTC m=+44.939797876" watchObservedRunningTime="2026-07-27 20:04:33.746376476 +0000 UTC m=+44.940154858"
Jul 27 20:04:33.763117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.763066    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gxh9r" podStartSLOduration=2.1260707070000002 podStartE2EDuration="9.763047672s" totalImagesPullingTime="7.636976965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:33.762406853 +0000 UTC m=+44.956185234" watchObservedRunningTime="2026-07-27 20:04:33.763047672 +0000 UTC m=+44.956826052"
Jul 27 20:04:33.781830 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:33.781775    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd8d7b56-pdz8c" podStartSLOduration=9.130997256 podStartE2EDuration="16.78175802s" totalImagesPullingTime="7.650760764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:33.78104851 +0000 UTC m=+44.974826895" watchObservedRunningTime="2026-07-27 20:04:33.78175802 +0000 UTC m=+44.975536401"
Jul 27 20:04:40.494154 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:40.494117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:40.494154 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:40.494157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:40.494580 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:40.494279    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:40.494580 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:40.494292    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:40.494580 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:40.494306    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:40.494580 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:40.494344    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:04:56.494329789 +0000 UTC m=+67.688108148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:40.494580 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:40.494363    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:56.49435309 +0000 UTC m=+67.688131455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:04:49.659524 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:49.659497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gbkl2"
Jul 27 20:04:55.004628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.004589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:04:55.008029 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.008009    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:04:55.015440 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:55.015410    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:04:55.015562 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:55.015552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs podName:1a332b09-8a59-4f57-ba41-c0bbb27b67ae nodeName:}" failed. No retries permitted until 2026-07-27 20:05:59.015525942 +0000 UTC m=+130.209304317 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs") pod "network-metrics-daemon-jlwcv" (UID: "1a332b09-8a59-4f57-ba41-c0bbb27b67ae") : secret "metrics-daemon-secret" not found
Jul 27 20:04:55.105645 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.105610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:55.105764 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.105699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:55.108672 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.108648    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:04:55.108796 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.108651    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:04:55.118556 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.118534    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:04:55.119541 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.119522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048b905f-b8e5-4d6f-a055-7a9a4735d314-original-pull-secret\") pod \"global-pull-secret-syncer-wqggf\" (UID: \"048b905f-b8e5-4d6f-a055-7a9a4735d314\") " pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:55.129022 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.128995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmgt\" (UniqueName: \"kubernetes.io/projected/5c6c1429-49bb-479a-b581-9107fb8bf832-kube-api-access-8vmgt\") pod \"network-check-target-9xzfv\" (UID: \"5c6c1429-49bb-479a-b581-9107fb8bf832\") " pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:55.133770 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.133749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqggf"
Jul 27 20:04:55.257154 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.257078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqggf"]
Jul 27 20:04:55.260524 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:55.260498    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048b905f_b8e5_4d6f_a055_7a9a4735d314.slice/crio-cf52e8fbc0b43144eddfaa9c4dbda9e10871222a61e61a3ad9dd70cbaa2f0cf5 WatchSource:0}: Error finding container cf52e8fbc0b43144eddfaa9c4dbda9e10871222a61e61a3ad9dd70cbaa2f0cf5: Status 404 returned error can't find the container with id cf52e8fbc0b43144eddfaa9c4dbda9e10871222a61e61a3ad9dd70cbaa2f0cf5
Jul 27 20:04:55.430535 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.430504    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkj9h\""
Jul 27 20:04:55.438534 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.438517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:04:55.562024 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.561996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xzfv"]
Jul 27 20:04:55.565341 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:04:55.565316    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6c1429_49bb_479a_b581_9107fb8bf832.slice/crio-0a14227b7828f8d83b25ea579fa2ee7999042f47fc4537c1e87199761bc9ce5f WatchSource:0}: Error finding container 0a14227b7828f8d83b25ea579fa2ee7999042f47fc4537c1e87199761bc9ce5f: Status 404 returned error can't find the container with id 0a14227b7828f8d83b25ea579fa2ee7999042f47fc4537c1e87199761bc9ce5f
Jul 27 20:04:55.775392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.775303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xzfv" event={"ID":"5c6c1429-49bb-479a-b581-9107fb8bf832","Type":"ContainerStarted","Data":"0a14227b7828f8d83b25ea579fa2ee7999042f47fc4537c1e87199761bc9ce5f"}
Jul 27 20:04:55.776234 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:55.776213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqggf" event={"ID":"048b905f-b8e5-4d6f-a055-7a9a4735d314","Type":"ContainerStarted","Data":"cf52e8fbc0b43144eddfaa9c4dbda9e10871222a61e61a3ad9dd70cbaa2f0cf5"}
Jul 27 20:04:56.516953 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:56.516917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:04:56.516969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:56.517095    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:56.517099    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:56.517206    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:56.517191    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:28.517151145 +0000 UTC m=+99.710929527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:56.517396 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:04:56.517258    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:05:28.517245338 +0000 UTC m=+99.711023698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:05:00.794439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:00.794395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xzfv" event={"ID":"5c6c1429-49bb-479a-b581-9107fb8bf832","Type":"ContainerStarted","Data":"50c64c40766b99a7527dd093785d875298a4590a0e4e25a6731cc8e0ac3d488b"}
Jul 27 20:05:00.794906 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:00.794605    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:05:00.795942 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:00.795919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqggf" event={"ID":"048b905f-b8e5-4d6f-a055-7a9a4735d314","Type":"ContainerStarted","Data":"990d518bca34a025b3410144ad78eb85d94b798a67ac06174f76a689f9395511"}
Jul 27 20:05:00.827480 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:00.827439    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wqggf" podStartSLOduration=65.505188713 podStartE2EDuration="1m10.827424942s" totalImagesPullingTime="5.322236229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:00.827114542 +0000 UTC m=+72.020892925" watchObservedRunningTime="2026-07-27 20:05:00.827424942 +0000 UTC m=+72.021203317"
Jul 27 20:05:00.827647 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:00.827627    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9xzfv" podStartSLOduration=65.813485724 podStartE2EDuration="1m10.827621519s" totalImagesPullingTime="5.014135795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:00.811315158 +0000 UTC m=+72.005093556" watchObservedRunningTime="2026-07-27 20:05:00.827621519 +0000 UTC m=+72.021399908"
Jul 27 20:05:28.556980 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:28.556931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:05:28.556980 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:28.556984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") pod \"image-registry-777bf47b9-x5pc8\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") " pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:05:28.557455 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:28.557077    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:05:28.557455 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:28.557087    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777bf47b9-x5pc8: secret "image-registry-tls" not found
Jul 27 20:05:28.557455 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:28.557092    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:05:28.557455 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:28.557145    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls podName:50650d67-714f-467b-858b-f444a40de57b nodeName:}" failed. No retries permitted until 2026-07-27 20:06:32.557131657 +0000 UTC m=+163.750910016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls") pod "image-registry-777bf47b9-x5pc8" (UID: "50650d67-714f-467b-858b-f444a40de57b") : secret "image-registry-tls" not found
Jul 27 20:05:28.557455 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:28.557158    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls podName:e84b359d-9689-463a-9fd5-c9eb87e2bf1f nodeName:}" failed. No retries permitted until 2026-07-27 20:06:32.557152267 +0000 UTC m=+163.750930625 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls") pod "dns-default-26s9d" (UID: "e84b359d-9689-463a-9fd5-c9eb87e2bf1f") : secret "dns-default-metrics-tls" not found
Jul 27 20:05:31.801091 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:31.801064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9xzfv"
Jul 27 20:05:38.713858 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.713827    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rcv8x"]
Jul 27 20:05:38.716776 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.716759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.719474 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.719450    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:05:38.719769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.719752    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:05:38.720382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.720363    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fdzc\""
Jul 27 20:05:38.720605 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.720592    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:05:38.721286 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.721273    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:05:38.733581 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.733560    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcv8x"]
Jul 27 20:05:38.834243 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.834207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.834243 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.834252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8db1420a-d725-44d6-9a29-d625a4bfdff5-crio-socket\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.834494 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.834272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2h6h\" (UniqueName: \"kubernetes.io/projected/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-api-access-v2h6h\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.834494 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.834394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8db1420a-d725-44d6-9a29-d625a4bfdff5-data-volume\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.834494 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.834474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935446 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2h6h\" (UniqueName: \"kubernetes.io/projected/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-api-access-v2h6h\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8db1420a-d725-44d6-9a29-d625a4bfdff5-data-volume\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935628 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:38.935621    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:38.935791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935791 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:38.935684    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:39.435666421 +0000 UTC m=+110.629444798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:38.935791 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:38.935705    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:38.935791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8db1420a-d725-44d6-9a29-d625a4bfdff5-crio-socket\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.935791 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:38.935784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:39.435765791 +0000 UTC m=+110.629544151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:38.936008 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8db1420a-d725-44d6-9a29-d625a4bfdff5-crio-socket\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.936008 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.935897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8db1420a-d725-44d6-9a29-d625a4bfdff5-data-volume\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:38.943317 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:38.943294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2h6h\" (UniqueName: \"kubernetes.io/projected/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-api-access-v2h6h\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:39.438320 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:39.438289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:39.438510 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:39.438338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:39.438510 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:39.438440    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:39.438510 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:39.438486    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:39.441878 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:39.438784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:40.438615464 +0000 UTC m=+111.632393837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:39.441878 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:39.438935    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:40.43891086 +0000 UTC m=+111.632689222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:40.447219 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:40.447161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:40.447595 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:40.447236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:40.447595 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:40.447321    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:40.447595 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:40.447389    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:42.447374624 +0000 UTC m=+113.641152987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:40.447595 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:40.447321    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:40.447595 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:40.447461    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:42.447448266 +0000 UTC m=+113.641226624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:40.518662 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:40.518638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgxdm_53761cb1-df13-4c43-ae36-69c409c4aeae/dns-node-resolver/0.log"
Jul 27 20:05:41.520256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:41.520227    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7gj2n_5cfe87db-d6b5-424f-84ef-1143c76da5f5/node-ca/0.log"
Jul 27 20:05:42.319684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:42.319649    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxh9r_20cbf953-46ee-4c3a-951d-52b0a272b6b3/serve-healthcheck-canary/0.log"
Jul 27 20:05:42.463685 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:42.463656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:42.463824 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:42.463763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:42.463824 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:42.463771    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:42.463894 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:42.463834    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:46.463814217 +0000 UTC m=+117.657592579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:42.463894 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:42.463853    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:42.463894 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:42.463892    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:46.463881515 +0000 UTC m=+117.657659874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:44.959444 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:44.959394    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" podUID="66fba0e4-fa0f-44ae-887a-2fb4b6152abb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 20:05:46.493577 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:46.493540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:46.493993 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:46.493597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:46.493993 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:46.493696    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:46.493993 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:46.493762    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:54.493747488 +0000 UTC m=+125.687525847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:46.493993 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:46.493697    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:46.493993 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:05:46.493863    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm podName:8db1420a-d725-44d6-9a29-d625a4bfdff5 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:54.493845287 +0000 UTC m=+125.687623657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcv8x" (UID: "8db1420a-d725-44d6-9a29-d625a4bfdff5") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:54.557647 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.557597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:54.557647 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.557656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:54.558130 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.558111    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8db1420a-d725-44d6-9a29-d625a4bfdff5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:54.559872 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.559842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8db1420a-d725-44d6-9a29-d625a4bfdff5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcv8x\" (UID: \"8db1420a-d725-44d6-9a29-d625a4bfdff5\") " pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:54.629115 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.629089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fdzc\""
Jul 27 20:05:54.637050 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.637030    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcv8x"
Jul 27 20:05:54.768442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.768421    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcv8x"]
Jul 27 20:05:54.770466 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:05:54.770440    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db1420a_d725_44d6_9a29_d625a4bfdff5.slice/crio-0abb5954b510ddb0dc775c6ecf8bc9bac0c08606497f30b951c52722a1aae6fc WatchSource:0}: Error finding container 0abb5954b510ddb0dc775c6ecf8bc9bac0c08606497f30b951c52722a1aae6fc: Status 404 returned error can't find the container with id 0abb5954b510ddb0dc775c6ecf8bc9bac0c08606497f30b951c52722a1aae6fc
Jul 27 20:05:54.950278 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.950240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcv8x" event={"ID":"8db1420a-d725-44d6-9a29-d625a4bfdff5","Type":"ContainerStarted","Data":"0abb5954b510ddb0dc775c6ecf8bc9bac0c08606497f30b951c52722a1aae6fc"}
Jul 27 20:05:54.959229 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:54.959196    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" podUID="66fba0e4-fa0f-44ae-887a-2fb4b6152abb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 20:05:59.094235 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.094191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:05:59.096477 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.096448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a332b09-8a59-4f57-ba41-c0bbb27b67ae-metrics-certs\") pod \"network-metrics-daemon-jlwcv\" (UID: \"1a332b09-8a59-4f57-ba41-c0bbb27b67ae\") " pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:05:59.139902 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.139842    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hkrg\""
Jul 27 20:05:59.148097 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.148067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlwcv"
Jul 27 20:05:59.732083 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.732052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jlwcv"]
Jul 27 20:05:59.735010 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:05:59.734981    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a332b09_8a59_4f57_ba41_c0bbb27b67ae.slice/crio-d89ea4e0304393ab6b498c5ac4d94b314ad1180a0e7821cf9df6a0c802c2dbb2 WatchSource:0}: Error finding container d89ea4e0304393ab6b498c5ac4d94b314ad1180a0e7821cf9df6a0c802c2dbb2: Status 404 returned error can't find the container with id d89ea4e0304393ab6b498c5ac4d94b314ad1180a0e7821cf9df6a0c802c2dbb2
Jul 27 20:05:59.970816 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.970781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcv8x" event={"ID":"8db1420a-d725-44d6-9a29-d625a4bfdff5","Type":"ContainerStarted","Data":"2f66edf24c2444e9cba4ee1b2290f1c3b693e424d37a683d8cd862837afa3395"}
Jul 27 20:05:59.971829 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:05:59.971804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlwcv" event={"ID":"1a332b09-8a59-4f57-ba41-c0bbb27b67ae","Type":"ContainerStarted","Data":"d89ea4e0304393ab6b498c5ac4d94b314ad1180a0e7821cf9df6a0c802c2dbb2"}
Jul 27 20:06:00.977385 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:00.977344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlwcv" event={"ID":"1a332b09-8a59-4f57-ba41-c0bbb27b67ae","Type":"ContainerStarted","Data":"6acaaa5c77227a38678537180ee337c08cfa80acb3c3587d3538fd17ccecf7f2"}
Jul 27 20:06:00.977801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:00.977405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlwcv" event={"ID":"1a332b09-8a59-4f57-ba41-c0bbb27b67ae","Type":"ContainerStarted","Data":"41562f006b1fd40124298e986125aae57bfbd6a2c0aaac6ee052af0a89f3a66a"}
Jul 27 20:06:03.991056 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:03.991014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcv8x" event={"ID":"8db1420a-d725-44d6-9a29-d625a4bfdff5","Type":"ContainerStarted","Data":"509a5ece785e6d0ff4df557f970661fa2e53fa0603c8d2b5d53675d2f08a9096"}
Jul 27 20:06:04.959593 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:04.959554    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" podUID="66fba0e4-fa0f-44ae-887a-2fb4b6152abb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 20:06:04.959780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:04.959635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92"
Jul 27 20:06:04.960240 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:04.960188    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"05f16aa2fbfcb64e41d84a876a15a7377ae69321165ec8bfed6ecb2c1bd3d53e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 27 20:06:04.960362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:04.960265    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" podUID="66fba0e4-fa0f-44ae-887a-2fb4b6152abb" containerName="service-proxy" containerID="cri-o://05f16aa2fbfcb64e41d84a876a15a7377ae69321165ec8bfed6ecb2c1bd3d53e" gracePeriod=30
Jul 27 20:06:06.000685 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:06.000633    2575 generic.go:356] "Generic (PLEG): container finished" podID="66fba0e4-fa0f-44ae-887a-2fb4b6152abb" containerID="05f16aa2fbfcb64e41d84a876a15a7377ae69321165ec8bfed6ecb2c1bd3d53e" exitCode=2
Jul 27 20:06:06.001099 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:06.000714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerDied","Data":"05f16aa2fbfcb64e41d84a876a15a7377ae69321165ec8bfed6ecb2c1bd3d53e"}
Jul 27 20:06:07.005906 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:07.005807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5456dcbd8d-7rx92" event={"ID":"66fba0e4-fa0f-44ae-887a-2fb4b6152abb","Type":"ContainerStarted","Data":"50b9eda64172c435a4d2a6b4cdedc42f73f36a6e4318bbf62b889ad69623c438"}
Jul 27 20:06:07.007794 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:07.007770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcv8x" event={"ID":"8db1420a-d725-44d6-9a29-d625a4bfdff5","Type":"ContainerStarted","Data":"52a2e331d7884945b33f70996e35214b5d291a6947d00b820c675bd36508c52a"}
Jul 27 20:06:07.039486 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:07.039433    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jlwcv" podStartSLOduration=136.006366798 podStartE2EDuration="2m17.039415107s" totalImagesPullingTime="1.033048309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:01.024317319 +0000 UTC m=+132.218095700" watchObservedRunningTime="2026-07-27 20:06:07.039415107 +0000 UTC m=+138.233193486"
Jul 27 20:06:07.060052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:07.059993    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rcv8x" podStartSLOduration=17.190985696 podStartE2EDuration="29.059976485s" totalImagesPullingTime="11.868990789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:05:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:07.05832925 +0000 UTC m=+138.252107644" watchObservedRunningTime="2026-07-27 20:06:07.059976485 +0000 UTC m=+138.253754864"
Jul 27 20:06:22.963284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:22.963250    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777bf47b9-x5pc8"]
Jul 27 20:06:22.963660 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:06:22.963416    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-777bf47b9-x5pc8" podUID="50650d67-714f-467b-858b-f444a40de57b"
Jul 27 20:06:23.052824 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.052796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:06:23.059011 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.058987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:06:23.185539 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgqx8\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.185723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.185723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185623    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.185723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185666    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.185893 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.185976 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185961    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.186046 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.185995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca\") pod \"50650d67-714f-467b-858b-f444a40de57b\" (UID: \"50650d67-714f-467b-858b-f444a40de57b\") "
Jul 27 20:06:23.186110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.186040    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:23.186234 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.186216    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-registry-certificates\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.186308 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.186202    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:23.186529 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.186495    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:23.188018 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.187984    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:23.188126 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.188041    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:23.188206 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.188125    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8" (OuterVolumeSpecName: "kube-api-access-pgqx8") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "kube-api-access-pgqx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:23.188206 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.188158    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "50650d67-714f-467b-858b-f444a40de57b" (UID: "50650d67-714f-467b-858b-f444a40de57b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:23.287239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287145    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgqx8\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-kube-api-access-pgqx8\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.287239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287172    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-image-registry-private-configuration\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.287239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287209    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-bound-sa-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.287239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287220    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50650d67-714f-467b-858b-f444a40de57b-ca-trust-extracted\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.287239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287233    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50650d67-714f-467b-858b-f444a40de57b-installation-pull-secrets\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:23.287457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:23.287245    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50650d67-714f-467b-858b-f444a40de57b-trusted-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:24.055823 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:24.055791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777bf47b9-x5pc8"
Jul 27 20:06:24.103338 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:24.103308    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777bf47b9-x5pc8"]
Jul 27 20:06:24.109164 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:24.109142    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-777bf47b9-x5pc8"]
Jul 27 20:06:24.194834 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:24.194811    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50650d67-714f-467b-858b-f444a40de57b-registry-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:06:25.422319 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:25.422287    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50650d67-714f-467b-858b-f444a40de57b" path="/var/lib/kubelet/pods/50650d67-714f-467b-858b-f444a40de57b/volumes"
Jul 27 20:06:27.686734 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:06:27.686697    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-26s9d" podUID="e84b359d-9689-463a-9fd5-c9eb87e2bf1f"
Jul 27 20:06:28.066484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.066405    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26s9d"
Jul 27 20:06:28.363845 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.363769    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lplf2"]
Jul 27 20:06:28.367985 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.367967    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.371428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.371407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:06:28.371747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.371727    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:06:28.371826 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.371752    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvc48\""
Jul 27 20:06:28.372126 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.372107    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:06:28.372214 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.372116    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:06:28.372495 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.372479    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:06:28.372542 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.372528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:06:28.525814 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-sys\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.525919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.525919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.525919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-root\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.525919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-wtmp\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.526073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.525952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-metrics-client-ca\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.526073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.526010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-textfile\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.526073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.526038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-tls\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.526073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.526058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnq22\" (UniqueName: \"kubernetes.io/projected/9d981cf8-37b2-4895-b372-cf5b78ab47a0-kube-api-access-vnq22\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626513 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-sys\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626513 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626649 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-sys\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626649 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626649 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-root\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626649 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-wtmp\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-root\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-metrics-client-ca\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626780 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-textfile\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626880 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-tls\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626880 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-wtmp\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.626880 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.626809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnq22\" (UniqueName: \"kubernetes.io/projected/9d981cf8-37b2-4895-b372-cf5b78ab47a0-kube-api-access-vnq22\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.627048 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.627027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-textfile\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.627195 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.627115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.627500 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.627476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d981cf8-37b2-4895-b372-cf5b78ab47a0-metrics-client-ca\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.629405 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.629383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.629937 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.629913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d981cf8-37b2-4895-b372-cf5b78ab47a0-node-exporter-tls\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.646022 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.645998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnq22\" (UniqueName: \"kubernetes.io/projected/9d981cf8-37b2-4895-b372-cf5b78ab47a0-kube-api-access-vnq22\") pod \"node-exporter-lplf2\" (UID: \"9d981cf8-37b2-4895-b372-cf5b78ab47a0\") " pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.677430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:28.677410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lplf2"
Jul 27 20:06:28.687138 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:06:28.687111    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d981cf8_37b2_4895_b372_cf5b78ab47a0.slice/crio-34a0a3353cf4d434edddb387c58b69ba48aae2864b91f46d0a016368dd61564a WatchSource:0}: Error finding container 34a0a3353cf4d434edddb387c58b69ba48aae2864b91f46d0a016368dd61564a: Status 404 returned error can't find the container with id 34a0a3353cf4d434edddb387c58b69ba48aae2864b91f46d0a016368dd61564a
Jul 27 20:06:29.071385 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:29.071347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lplf2" event={"ID":"9d981cf8-37b2-4895-b372-cf5b78ab47a0","Type":"ContainerStarted","Data":"34a0a3353cf4d434edddb387c58b69ba48aae2864b91f46d0a016368dd61564a"}
Jul 27 20:06:30.076389 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:30.076260    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d981cf8-37b2-4895-b372-cf5b78ab47a0" containerID="2497684e9b028005e34eca932b6fa6f8e1049d32426b17c9fa0afe985444140b" exitCode=0
Jul 27 20:06:30.076389 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:30.076329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lplf2" event={"ID":"9d981cf8-37b2-4895-b372-cf5b78ab47a0","Type":"ContainerDied","Data":"2497684e9b028005e34eca932b6fa6f8e1049d32426b17c9fa0afe985444140b"}
Jul 27 20:06:31.082107 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:31.082059    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lplf2" event={"ID":"9d981cf8-37b2-4895-b372-cf5b78ab47a0","Type":"ContainerStarted","Data":"bcab1e3a58bff36b59669231e40f1320dcadd9ddf4ee07aad6e6fa90685cee0b"}
Jul 27 20:06:31.082600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:31.082123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lplf2" event={"ID":"9d981cf8-37b2-4895-b372-cf5b78ab47a0","Type":"ContainerStarted","Data":"171fe587b4f00bd041f2020c5ff164f2fc4de4063b51a64181096268ef2d1885"}
Jul 27 20:06:31.109704 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:31.109651    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lplf2" podStartSLOduration=2.075264481 podStartE2EDuration="3.109631813s" totalImagesPullingTime="972.09545ms" totalInitContainerRuntime="62.271882ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:31.107896424 +0000 UTC m=+162.301674805" watchObservedRunningTime="2026-07-27 20:06:31.109631813 +0000 UTC m=+162.303410194"
Jul 27 20:06:32.656313 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:32.656278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:06:32.658598 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:32.658580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84b359d-9689-463a-9fd5-c9eb87e2bf1f-metrics-tls\") pod \"dns-default-26s9d\" (UID: \"e84b359d-9689-463a-9fd5-c9eb87e2bf1f\") " pod="openshift-dns/dns-default-26s9d"
Jul 27 20:06:32.870644 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:32.870615    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k4bq\""
Jul 27 20:06:32.878165 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:32.878147    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26s9d"
Jul 27 20:06:33.218472 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:06:33.218438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84b359d_9689_463a_9fd5_c9eb87e2bf1f.slice/crio-e2bc1de777361729a9283815fc8a395ea35593a311d2a98ee2558c52d00b53af WatchSource:0}: Error finding container e2bc1de777361729a9283815fc8a395ea35593a311d2a98ee2558c52d00b53af: Status 404 returned error can't find the container with id e2bc1de777361729a9283815fc8a395ea35593a311d2a98ee2558c52d00b53af
Jul 27 20:06:33.218848 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:33.218827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26s9d"]
Jul 27 20:06:34.094620 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:34.094584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26s9d" event={"ID":"e84b359d-9689-463a-9fd5-c9eb87e2bf1f","Type":"ContainerStarted","Data":"e2bc1de777361729a9283815fc8a395ea35593a311d2a98ee2558c52d00b53af"}
Jul 27 20:06:36.102473 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:36.102435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26s9d" event={"ID":"e84b359d-9689-463a-9fd5-c9eb87e2bf1f","Type":"ContainerStarted","Data":"97c7fa7622343e350ea2e7ab6887af5f5fa6927d7b742d87cdef2ac81d9ac906"}
Jul 27 20:06:36.102936 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:36.102483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26s9d" event={"ID":"e84b359d-9689-463a-9fd5-c9eb87e2bf1f","Type":"ContainerStarted","Data":"e6d623ae31861d0a8a6c2648f8aaff373349fdc36bc08afea9d68f91dbb17fd8"}
Jul 27 20:06:36.102936 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:36.102513    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26s9d"
Jul 27 20:06:36.129222 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:36.129150    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26s9d" podStartSLOduration=129.925736462 podStartE2EDuration="2m12.129135845s" totalImagesPullingTime="2.203399383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:36.12830342 +0000 UTC m=+167.322081819" watchObservedRunningTime="2026-07-27 20:06:36.129135845 +0000 UTC m=+167.322914226"
Jul 27 20:06:46.108111 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:06:46.108039    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26s9d"
Jul 27 20:08:49.181029 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:08:49.181000    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:11:05.650238 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.650209    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mt67q"]
Jul 27 20:11:05.653017 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.653002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.655322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.655304    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:11:05.655423 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.655327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w9qpl\""
Jul 27 20:11:05.656010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.655991    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:11:05.664155 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.664134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mt67q"]
Jul 27 20:11:05.688875 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.688852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cc9r\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-kube-api-access-9cc9r\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.688989 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.688915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.790211 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.790166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cc9r\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-kube-api-access-9cc9r\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.790322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.790241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.798332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.798306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.798468 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.798449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cc9r\" (UniqueName: \"kubernetes.io/projected/25af7dbd-9def-4e79-becb-1537807efef1-kube-api-access-9cc9r\") pod \"cert-manager-55b4d954d5-mt67q\" (UID: \"25af7dbd-9def-4e79-becb-1537807efef1\") " pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:05.961722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:05.961645    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mt67q"
Jul 27 20:11:06.081353 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:06.081324    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mt67q"]
Jul 27 20:11:06.084698 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:11:06.084666    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25af7dbd_9def_4e79_becb_1537807efef1.slice/crio-1c65e4dff6e6b4bf4044106296829d093d73ec9742c42cea177b11c44bc0b519 WatchSource:0}: Error finding container 1c65e4dff6e6b4bf4044106296829d093d73ec9742c42cea177b11c44bc0b519: Status 404 returned error can't find the container with id 1c65e4dff6e6b4bf4044106296829d093d73ec9742c42cea177b11c44bc0b519
Jul 27 20:11:06.086557 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:06.086540    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:11:06.954998 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:06.954961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mt67q" event={"ID":"25af7dbd-9def-4e79-becb-1537807efef1","Type":"ContainerStarted","Data":"1c65e4dff6e6b4bf4044106296829d093d73ec9742c42cea177b11c44bc0b519"}
Jul 27 20:11:10.973825 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:10.973783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mt67q" event={"ID":"25af7dbd-9def-4e79-becb-1537807efef1","Type":"ContainerStarted","Data":"ff65d7c08a71ccfac49a05b605bc174254f9a3681a98848c7fc77cf2479eb385"}
Jul 27 20:11:10.992398 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:10.992344    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mt67q" podStartSLOduration=1.2567142439999999 podStartE2EDuration="5.992329354s" totalImagesPullingTime="4.73561511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:10.991423595 +0000 UTC m=+442.185201975" watchObservedRunningTime="2026-07-27 20:11:10.992329354 +0000 UTC m=+442.186107735"
Jul 27 20:11:33.152119 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.152077    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"]
Jul 27 20:11:33.155396 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.155374    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.158302 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.158263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:11:33.158453 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.158312    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:11:33.158453 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.158361    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nflwb\""
Jul 27 20:11:33.158453 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.158361    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:11:33.158595 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.158464    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:11:33.170001 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.169978    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"]
Jul 27 20:11:33.285456 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.285423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.285622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.285476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.285622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.285532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4fx\" (UniqueName: \"kubernetes.io/projected/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-kube-api-access-xx4fx\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.285622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.285578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.285622 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.285605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.386677 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.386627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.386677 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.386688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.386921 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.386726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.386921 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.386743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4fx\" (UniqueName: \"kubernetes.io/projected/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-kube-api-access-xx4fx\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.386921 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.386766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.387151 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.387130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.388886 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.388865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.389122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.389105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.389197 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.389141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.398279 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.398253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4fx\" (UniqueName: \"kubernetes.io/projected/d5a5ab85-a4fa-49ad-a689-266cfe3ff585-kube-api-access-xx4fx\") pod \"opendatahub-operator-controller-manager-67944f57b-vfbqx\" (UID: \"d5a5ab85-a4fa-49ad-a689-266cfe3ff585\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.465916 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.465813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:33.600804 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:33.600771    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"]
Jul 27 20:11:33.603961 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:11:33.603934    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a5ab85_a4fa_49ad_a689_266cfe3ff585.slice/crio-aec580694e1afa4adece76676da7ab5e11ac3d000817756005cccfe13e60d411 WatchSource:0}: Error finding container aec580694e1afa4adece76676da7ab5e11ac3d000817756005cccfe13e60d411: Status 404 returned error can't find the container with id aec580694e1afa4adece76676da7ab5e11ac3d000817756005cccfe13e60d411
Jul 27 20:11:34.046359 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:34.046325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx" event={"ID":"d5a5ab85-a4fa-49ad-a689-266cfe3ff585","Type":"ContainerStarted","Data":"aec580694e1afa4adece76676da7ab5e11ac3d000817756005cccfe13e60d411"}
Jul 27 20:11:37.060062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:37.059974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx" event={"ID":"d5a5ab85-a4fa-49ad-a689-266cfe3ff585","Type":"ContainerStarted","Data":"7d84935eced6c6c7bd00d67d21c032f1b11bee3a81dce7a805e6b848bef02523"}
Jul 27 20:11:38.064446 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:38.064404    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5a5ab85-a4fa-49ad-a689-266cfe3ff585" containerID="7d84935eced6c6c7bd00d67d21c032f1b11bee3a81dce7a805e6b848bef02523" exitCode=0
Jul 27 20:11:38.064804 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:38.064487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx" event={"ID":"d5a5ab85-a4fa-49ad-a689-266cfe3ff585","Type":"ContainerDied","Data":"7d84935eced6c6c7bd00d67d21c032f1b11bee3a81dce7a805e6b848bef02523"}
Jul 27 20:11:39.069975 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:39.069943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx" event={"ID":"d5a5ab85-a4fa-49ad-a689-266cfe3ff585","Type":"ContainerStarted","Data":"72df2ce0aa0d89d7e5ec9e504f57274f6d3cab93576e2aef770e06a3c422269f"}
Jul 27 20:11:39.070470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:39.070054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:39.092493 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:39.092443    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx" podStartSLOduration=1.663732205 podStartE2EDuration="6.09242916s" totalImagesPullingTime="3.364641586s" totalInitContainerRuntime="1.064055369s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:39.092108359 +0000 UTC m=+470.285886738" watchObservedRunningTime="2026-07-27 20:11:39.09242916 +0000 UTC m=+470.286207541"
Jul 27 20:11:50.075033 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:50.075001    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-vfbqx"
Jul 27 20:11:51.254751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.254717    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"]
Jul 27 20:11:51.257600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.257583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.259973 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.259951    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 20:11:51.260120 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.260102    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 20:11:51.261056 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.261034    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 20:11:51.261170 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.261063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 20:11:51.261170 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.261062    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:11:51.261170 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.261142    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cndlz\""
Jul 27 20:11:51.266626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.266604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"]
Jul 27 20:11:51.413563 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.413525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.413563 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.413565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78db697f-5cf5-4ed9-8d23-03444cd04c34-manager-config\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.413776 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.413635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqj4\" (UniqueName: \"kubernetes.io/projected/78db697f-5cf5-4ed9-8d23-03444cd04c34-kube-api-access-hhqj4\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.413776 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.413674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.514569 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.514485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78db697f-5cf5-4ed9-8d23-03444cd04c34-manager-config\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.514569 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.514527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqj4\" (UniqueName: \"kubernetes.io/projected/78db697f-5cf5-4ed9-8d23-03444cd04c34-kube-api-access-hhqj4\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.514569 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.514561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.514787 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.514594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.515272 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.515239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78db697f-5cf5-4ed9-8d23-03444cd04c34-manager-config\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.516941 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.516916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.517126 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.517109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db697f-5cf5-4ed9-8d23-03444cd04c34-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.534423 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.534396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqj4\" (UniqueName: \"kubernetes.io/projected/78db697f-5cf5-4ed9-8d23-03444cd04c34-kube-api-access-hhqj4\") pod \"lws-controller-manager-7f9b5765bb-9jcxd\" (UID: \"78db697f-5cf5-4ed9-8d23-03444cd04c34\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.566800 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.566777    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:51.701449 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:51.701415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"]
Jul 27 20:11:51.704206 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:11:51.704168    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78db697f_5cf5_4ed9_8d23_03444cd04c34.slice/crio-c50e9c944c6880bdabff4fac3f16e921bb3d822d5c73bd111f2354cee3f0076f WatchSource:0}: Error finding container c50e9c944c6880bdabff4fac3f16e921bb3d822d5c73bd111f2354cee3f0076f: Status 404 returned error can't find the container with id c50e9c944c6880bdabff4fac3f16e921bb3d822d5c73bd111f2354cee3f0076f
Jul 27 20:11:52.115488 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:52.115451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd" event={"ID":"78db697f-5cf5-4ed9-8d23-03444cd04c34","Type":"ContainerStarted","Data":"c50e9c944c6880bdabff4fac3f16e921bb3d822d5c73bd111f2354cee3f0076f"}
Jul 27 20:11:55.132248 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:55.132214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd" event={"ID":"78db697f-5cf5-4ed9-8d23-03444cd04c34","Type":"ContainerStarted","Data":"51114a1308ef28410146136af49b8c92744497fad6c550fb00fbaa7be2bf5442"}
Jul 27 20:11:55.132641 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:55.132341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:11:55.168329 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:11:55.168269    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd" podStartSLOduration=1.5342697109999999 podStartE2EDuration="4.168252405s" totalImagesPullingTime="2.633982694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:55.166259251 +0000 UTC m=+486.360037646" watchObservedRunningTime="2026-07-27 20:11:55.168252405 +0000 UTC m=+486.362030784"
Jul 27 20:12:00.706755 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.706722    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"]
Jul 27 20:12:00.709655 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.709637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.715071 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715049    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:12:00.715227 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715210    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:12:00.715370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715349    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 20:12:00.715452 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 20:12:00.715452 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 20:12:00.716081 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715794    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z9jnb\""
Jul 27 20:12:00.716081 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.715795    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:12:00.727471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.727444    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"]
Jul 27 20:12:00.885826 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.885791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d2ae9-10f9-45cc-9342-2515a715c353-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.885826 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.885829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.886035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.885856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.886035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.885957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6gw\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-kube-api-access-6v6gw\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.886035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.886003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.886035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.886032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.886157 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.886052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.986747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.986747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.986747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6gw\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-kube-api-access-6v6gw\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.987005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.987005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.987005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.987005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.986875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d2ae9-10f9-45cc-9342-2515a715c353-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.987590 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.987562    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.989090 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.989059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d2ae9-10f9-45cc-9342-2515a715c353-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.989221 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.989203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.989295 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.989281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:00.989340 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:00.989325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/741d2ae9-10f9-45cc-9342-2515a715c353-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:01.016247 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:01.016218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6gw\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-kube-api-access-6v6gw\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:01.026066 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:01.026038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d2ae9-10f9-45cc-9342-2515a715c353-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7wvdc\" (UID: \"741d2ae9-10f9-45cc-9342-2515a715c353\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:01.318964 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:01.318872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:01.458979 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:01.458955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"]
Jul 27 20:12:01.460841 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:12:01.460814    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741d2ae9_10f9_45cc_9342_2515a715c353.slice/crio-d708e6f7454e331cdb3d56e267e53ffd991345e0411ea5493487c377060f433f WatchSource:0}: Error finding container d708e6f7454e331cdb3d56e267e53ffd991345e0411ea5493487c377060f433f: Status 404 returned error can't find the container with id d708e6f7454e331cdb3d56e267e53ffd991345e0411ea5493487c377060f433f
Jul 27 20:12:02.155903 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:02.155866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc" event={"ID":"741d2ae9-10f9-45cc-9342-2515a715c353","Type":"ContainerStarted","Data":"d708e6f7454e331cdb3d56e267e53ffd991345e0411ea5493487c377060f433f"}
Jul 27 20:12:03.957908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:03.957871    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:12:03.958243 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:03.957937    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:12:04.164481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:04.164450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc" event={"ID":"741d2ae9-10f9-45cc-9342-2515a715c353","Type":"ContainerStarted","Data":"06ef09ecebddd8c2bf09d8f32e5f4b6539770171c5ac85a6345e4bbd6fbd9434"}
Jul 27 20:12:04.164677 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:04.164582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:04.231709 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:04.231612    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc" podStartSLOduration=1.736760957 podStartE2EDuration="4.231592215s" totalImagesPullingTime="2.494831258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:12:04.228899017 +0000 UTC m=+495.422677416" watchObservedRunningTime="2026-07-27 20:12:04.231592215 +0000 UTC m=+495.425370596"
Jul 27 20:12:05.169530 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:05.169504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7wvdc"
Jul 27 20:12:06.138474 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:12:06.138439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-9jcxd"
Jul 27 20:15:01.371084 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.371049    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"]
Jul 27 20:15:01.373998 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.373982    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.377276 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.377020    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:15:01.377433 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.377282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:15:01.377659 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.377642    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-q476j\""
Jul 27 20:15:01.377730 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.377711    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 20:15:01.386447 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.386427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"]
Jul 27 20:15:01.439949 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.439918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dbafa1a-007a-4196-beb4-6f9ac0f43590-data\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.440130 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.440034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbn7g\" (UniqueName: \"kubernetes.io/projected/7dbafa1a-007a-4196-beb4-6f9ac0f43590-kube-api-access-pbn7g\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.540946 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.540901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbn7g\" (UniqueName: \"kubernetes.io/projected/7dbafa1a-007a-4196-beb4-6f9ac0f43590-kube-api-access-pbn7g\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.540946 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.540953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dbafa1a-007a-4196-beb4-6f9ac0f43590-data\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.541361 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.541344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dbafa1a-007a-4196-beb4-6f9ac0f43590-data\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.550551 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.550529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbn7g\" (UniqueName: \"kubernetes.io/projected/7dbafa1a-007a-4196-beb4-6f9ac0f43590-kube-api-access-pbn7g\") pod \"postgres-69fb4594cf-f9rdq\" (UID: \"7dbafa1a-007a-4196-beb4-6f9ac0f43590\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.684397 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.684355    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:01.810065 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:01.810022    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"]
Jul 27 20:15:01.812881 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:15:01.812829    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbafa1a_007a_4196_beb4_6f9ac0f43590.slice/crio-601b86ea549f85c744fbcfbd082c3fa73a7fda164e99a2b8d2d43dbe388d8b1a WatchSource:0}: Error finding container 601b86ea549f85c744fbcfbd082c3fa73a7fda164e99a2b8d2d43dbe388d8b1a: Status 404 returned error can't find the container with id 601b86ea549f85c744fbcfbd082c3fa73a7fda164e99a2b8d2d43dbe388d8b1a
Jul 27 20:15:02.778217 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:02.778161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq" event={"ID":"7dbafa1a-007a-4196-beb4-6f9ac0f43590","Type":"ContainerStarted","Data":"601b86ea549f85c744fbcfbd082c3fa73a7fda164e99a2b8d2d43dbe388d8b1a"}
Jul 27 20:15:08.804722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:08.804685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq" event={"ID":"7dbafa1a-007a-4196-beb4-6f9ac0f43590","Type":"ContainerStarted","Data":"c73e4ad2803195aecaf3a2708972aec85a3de0ad3b5dc0f62e1714c18abbd69b"}
Jul 27 20:15:08.805110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:08.804751    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:15:08.826474 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:08.826429    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq" podStartSLOduration=1.314314153 podStartE2EDuration="7.826413382s" totalImagesPullingTime="6.512099229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:08.824662167 +0000 UTC m=+680.018440552" watchObservedRunningTime="2026-07-27 20:15:08.826413382 +0000 UTC m=+680.020191762"
Jul 27 20:15:14.836642 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:15:14.836614    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f9rdq"
Jul 27 20:16:23.809693 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.809662    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"]
Jul 27 20:16:23.812652 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.812633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.815281 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.815256    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 20:16:23.815281 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.815270    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 20:16:23.815992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.815977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 20:16:23.816285 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.816273    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qvwsc\""
Jul 27 20:16:23.825547 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.825529    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"]
Jul 27 20:16:23.858779 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.858864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.858864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4t6\" (UniqueName: \"kubernetes.io/projected/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-kube-api-access-4x4t6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.858864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.858961 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.858961 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.858902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.959860 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.959828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.959868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.959889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.959909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.959935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4t6\" (UniqueName: \"kubernetes.io/projected/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-kube-api-access-4x4t6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960233 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.960097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960381 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.960354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960496 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.960368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.960496 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.960434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.962218 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.962190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.962487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.962467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:23.968416 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:23.968391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4t6\" (UniqueName: \"kubernetes.io/projected/48eda8d7-dde2-493d-99fa-ce72f43ff0e0-kube-api-access-4x4t6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6\" (UID: \"48eda8d7-dde2-493d-99fa-ce72f43ff0e0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:24.122491 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:24.122399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:24.248804 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:24.248769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"]
Jul 27 20:16:24.252610 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:16:24.252582    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eda8d7_dde2_493d_99fa_ce72f43ff0e0.slice/crio-2762ef9d725af2eda0998fb2eb20329cbb1600e6208417e9a0c95837dadd47e4 WatchSource:0}: Error finding container 2762ef9d725af2eda0998fb2eb20329cbb1600e6208417e9a0c95837dadd47e4: Status 404 returned error can't find the container with id 2762ef9d725af2eda0998fb2eb20329cbb1600e6208417e9a0c95837dadd47e4
Jul 27 20:16:24.254544 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:24.254525    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:16:25.075538 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:25.075499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6" event={"ID":"48eda8d7-dde2-493d-99fa-ce72f43ff0e0","Type":"ContainerStarted","Data":"2762ef9d725af2eda0998fb2eb20329cbb1600e6208417e9a0c95837dadd47e4"}
Jul 27 20:16:26.080433 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:26.080395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6" event={"ID":"48eda8d7-dde2-493d-99fa-ce72f43ff0e0","Type":"ContainerStarted","Data":"bf174a9711dcf8f0c667cbdb4055ffedfe0fec80b85bd595b2b7d108d41e1021"}
Jul 27 20:16:26.097658 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:26.097613    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6" podStartSLOduration=1.83083062 podStartE2EDuration="3.097596204s" totalImagesPullingTime="1.266765584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:16:26.09671755 +0000 UTC m=+757.290495936" watchObservedRunningTime="2026-07-27 20:16:26.097596204 +0000 UTC m=+757.291374585"
Jul 27 20:16:34.123604 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:34.123554    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:34.124116 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:34.123628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:34.136042 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:34.136013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:16:35.122495 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:16:35.122469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6"
Jul 27 20:17:00.007108 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.007065    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"]
Jul 27 20:17:00.011427 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.011405    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.013577 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.013545    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 20:17:00.020563 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.020541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"]
Jul 27 20:17:00.137554 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.137554 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.137760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.137760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.137760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whw5r\" (UniqueName: \"kubernetes.io/projected/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-kube-api-access-whw5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.137760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.137716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238409 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238599 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238599 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whw5r\" (UniqueName: \"kubernetes.io/projected/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-kube-api-access-whw5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238599 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238772 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238772 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238874 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238920 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.238986 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.238969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.240914 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.240893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.240998 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.240968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.246708 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.246688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whw5r\" (UniqueName: \"kubernetes.io/projected/a7d83156-6b62-4c2a-925c-a8f4c889f2fe-kube-api-access-whw5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxkfs\" (UID: \"a7d83156-6b62-4c2a-925c-a8f4c889f2fe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.321768 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.321681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:00.449611 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:00.449574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"]
Jul 27 20:17:00.452328 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:17:00.452297    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d83156_6b62_4c2a_925c_a8f4c889f2fe.slice/crio-0ddf4f9ccf2d2a6cf0ea46a9aff66fc84ce9b2454f69fba67d40a9427157f774 WatchSource:0}: Error finding container 0ddf4f9ccf2d2a6cf0ea46a9aff66fc84ce9b2454f69fba67d40a9427157f774: Status 404 returned error can't find the container with id 0ddf4f9ccf2d2a6cf0ea46a9aff66fc84ce9b2454f69fba67d40a9427157f774
Jul 27 20:17:01.206613 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:01.206577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs" event={"ID":"a7d83156-6b62-4c2a-925c-a8f4c889f2fe","Type":"ContainerStarted","Data":"130d616fc23ef90e0d89edfb0b276dd38f870cea3d308c8b574650f50f5f3cb9"}
Jul 27 20:17:01.207000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:01.206627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs" event={"ID":"a7d83156-6b62-4c2a-925c-a8f4c889f2fe","Type":"ContainerStarted","Data":"0ddf4f9ccf2d2a6cf0ea46a9aff66fc84ce9b2454f69fba67d40a9427157f774"}
Jul 27 20:17:01.229795 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:01.229740    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs" podStartSLOduration=1.937139915 podStartE2EDuration="2.229723547s" totalImagesPullingTime="292.583632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:01.228674682 +0000 UTC m=+792.422453074" watchObservedRunningTime="2026-07-27 20:17:01.229723547 +0000 UTC m=+792.423501927"
Jul 27 20:17:10.321890 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:10.321847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:10.322470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:10.321928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:10.334504 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:10.334467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:11.254291 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:11.254261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxkfs"
Jul 27 20:17:31.001150 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.001115    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"]
Jul 27 20:17:31.004262 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.004244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.006717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.006695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 20:17:31.013542 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.013516    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"]
Jul 27 20:17:31.083683 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.083683 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.083909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.083909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.083909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.083909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.083814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdnd7\" (UniqueName: \"kubernetes.io/projected/52ecf647-0b73-4808-9575-3a1a9eb99b9e-kube-api-access-sdnd7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185087 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185087 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdnd7\" (UniqueName: \"kubernetes.io/projected/52ecf647-0b73-4808-9575-3a1a9eb99b9e-kube-api-access-sdnd7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185595 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.185870 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.186012 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.185992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.187503 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.187482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ecf647-0b73-4808-9575-3a1a9eb99b9e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.188043 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.188020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ecf647-0b73-4808-9575-3a1a9eb99b9e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.196276 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.196249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdnd7\" (UniqueName: \"kubernetes.io/projected/52ecf647-0b73-4808-9575-3a1a9eb99b9e-kube-api-access-sdnd7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz\" (UID: \"52ecf647-0b73-4808-9575-3a1a9eb99b9e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.315481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.315394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:31.450609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:31.450583    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"]
Jul 27 20:17:31.452438 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:17:31.452408    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ecf647_0b73_4808_9575_3a1a9eb99b9e.slice/crio-4ec87cf7f01db4756d640bcad107eb92dcf5843550716ef20a95e7d24532aa0f WatchSource:0}: Error finding container 4ec87cf7f01db4756d640bcad107eb92dcf5843550716ef20a95e7d24532aa0f: Status 404 returned error can't find the container with id 4ec87cf7f01db4756d640bcad107eb92dcf5843550716ef20a95e7d24532aa0f
Jul 27 20:17:32.322928 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:32.322894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz" event={"ID":"52ecf647-0b73-4808-9575-3a1a9eb99b9e","Type":"ContainerStarted","Data":"51df44bb7d2e487b45816636832018646c722c8cb869a293ebef4d18c3cabbed"}
Jul 27 20:17:32.323345 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:32.322946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz" event={"ID":"52ecf647-0b73-4808-9575-3a1a9eb99b9e","Type":"ContainerStarted","Data":"4ec87cf7f01db4756d640bcad107eb92dcf5843550716ef20a95e7d24532aa0f"}
Jul 27 20:17:32.358267 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:32.358141    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz" podStartSLOduration=2.145049151 podStartE2EDuration="2.358120093s" totalImagesPullingTime="213.070942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:32.356927283 +0000 UTC m=+823.550705664" watchObservedRunningTime="2026-07-27 20:17:32.358120093 +0000 UTC m=+823.551898476"
Jul 27 20:17:41.316443 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:41.316410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:41.316944 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:41.316479    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:41.328934 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:41.328908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:17:41.364303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:17:41.364282    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz"
Jul 27 20:34:48.593138 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.593105    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:34:48.596256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.596235    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.599482 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.599462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9c50dc8e-serving-cert\""
Jul 27 20:34:48.599581 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.599514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-flzfl\""
Jul 27 20:34:48.612272 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.612250    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:34:48.697382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.697336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds6gt\" (UniqueName: \"kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.697557 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.697391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.697557 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.697483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.798619 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.798583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.798784 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.798633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.798784 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.798672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds6gt\" (UniqueName: \"kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.799368 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.799348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.801135 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.801110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.807392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.807369    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds6gt\" (UniqueName: \"kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt\") pod \"maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:48.905769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:48.905741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:49.031479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:49.031409    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:34:49.033715 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:34:49.033686    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d031ec_dca6_4761_a6fd_2b4521ffe88f.slice/crio-16325de5355b16e27116daa14a0c0be9fe17134ebe87239ad55858843a3104e8 WatchSource:0}: Error finding container 16325de5355b16e27116daa14a0c0be9fe17134ebe87239ad55858843a3104e8: Status 404 returned error can't find the container with id 16325de5355b16e27116daa14a0c0be9fe17134ebe87239ad55858843a3104e8
Jul 27 20:34:49.035523 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:49.035502    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:34:49.056920 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:49.056895    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" event={"ID":"f3d031ec-dca6-4761-a6fd-2b4521ffe88f","Type":"ContainerStarted","Data":"16325de5355b16e27116daa14a0c0be9fe17134ebe87239ad55858843a3104e8"}
Jul 27 20:34:52.073038 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:52.072949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" event={"ID":"f3d031ec-dca6-4761-a6fd-2b4521ffe88f","Type":"ContainerStarted","Data":"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"}
Jul 27 20:34:52.073429 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:52.073063    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:34:52.089132 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:52.089087    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" podStartSLOduration=1.48744634 podStartE2EDuration="4.08907085s" totalImagesPullingTime="2.60162451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:52.088117128 +0000 UTC m=+1863.281895526" watchObservedRunningTime="2026-07-27 20:34:52.08907085 +0000 UTC m=+1863.282849231"
Jul 27 20:34:58.082772 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:34:58.082741    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:35:24.503371 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.503292    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:35:24.503919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.503511    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" podUID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" containerName="maas-api" containerID="cri-o://a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315" gracePeriod=30
Jul 27 20:35:24.741972 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.741950    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:35:24.792564 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.792486    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds6gt\" (UniqueName: \"kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt\") pod \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") "
Jul 27 20:35:24.792564 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.792528    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca\") pod \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") "
Jul 27 20:35:24.792753 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.792592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls\") pod \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\" (UID: \"f3d031ec-dca6-4761-a6fd-2b4521ffe88f\") "
Jul 27 20:35:24.792929 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.792903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3d031ec-dca6-4761-a6fd-2b4521ffe88f" (UID: "f3d031ec-dca6-4761-a6fd-2b4521ffe88f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:35:24.794787 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.794762    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt" (OuterVolumeSpecName: "kube-api-access-ds6gt") pod "f3d031ec-dca6-4761-a6fd-2b4521ffe88f" (UID: "f3d031ec-dca6-4761-a6fd-2b4521ffe88f"). InnerVolumeSpecName "kube-api-access-ds6gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:24.794899 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.794879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3d031ec-dca6-4761-a6fd-2b4521ffe88f" (UID: "f3d031ec-dca6-4761-a6fd-2b4521ffe88f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:35:24.893293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.893261    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds6gt\" (UniqueName: \"kubernetes.io/projected/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-kube-api-access-ds6gt\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:35:24.893293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.893285    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:35:24.893293 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:24.893296    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d031ec-dca6-4761-a6fd-2b4521ffe88f-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:35:25.201161 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.201125    2575 generic.go:356] "Generic (PLEG): container finished" podID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" containerID="a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315" exitCode=0
Jul 27 20:35:25.201332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.201167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"
Jul 27 20:35:25.201332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.201215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" event={"ID":"f3d031ec-dca6-4761-a6fd-2b4521ffe88f","Type":"ContainerDied","Data":"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"}
Jul 27 20:35:25.201332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.201268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr" event={"ID":"f3d031ec-dca6-4761-a6fd-2b4521ffe88f","Type":"ContainerDied","Data":"16325de5355b16e27116daa14a0c0be9fe17134ebe87239ad55858843a3104e8"}
Jul 27 20:35:25.201332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.201290    2575 scope.go:117] "RemoveContainer" containerID="a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"
Jul 27 20:35:25.210110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.210088    2575 scope.go:117] "RemoveContainer" containerID="a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"
Jul 27 20:35:25.210394 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:35:25.210376    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315\": container with ID starting with a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315 not found: ID does not exist" containerID="a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"
Jul 27 20:35:25.210450 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.210405    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315"} err="failed to get container status \"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315\": rpc error: code = NotFound desc = could not find container \"a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315\": container with ID starting with a98a5a86ad79f2d37cea5da6362ed260f55ecf7f5f740d170075e48038de0315 not found: ID does not exist"
Jul 27 20:35:25.221402 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.221380    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:35:25.226530 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.226506    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9c50dc8e-55cb8c46bd-5jvcr"]
Jul 27 20:35:25.422648 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:25.422619    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" path="/var/lib/kubelet/pods/f3d031ec-dca6-4761-a6fd-2b4521ffe88f/volumes"
Jul 27 20:35:30.378083 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.378043    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:35:30.378530 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.378515    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" containerName="maas-api"
Jul 27 20:35:30.378578 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.378533    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" containerName="maas-api"
Jul 27 20:35:30.378628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.378617    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d031ec-dca6-4761-a6fd-2b4521ffe88f" containerName="maas-api"
Jul 27 20:35:30.382167 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.382146    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.384717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.384696    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-73a591cd-gw-openshift-default-dockercfg-w7fs8\""
Jul 27 20:35:30.393477 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.393455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:35:30.434274 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434403 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434403 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434473 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434473 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434552 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434616 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.434616 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.434575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgf6\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535311 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535484 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgf6\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535684 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.535868 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.535747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.536075 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.536048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.536539 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.536417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.536720 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.536482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.537836 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.537811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.539039 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.539016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.539126 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.539106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.545290 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.545260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.545471 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.545438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgf6\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6\") pod \"e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") " pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.692617 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.692580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:30.846258 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:30.846231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:35:30.847701 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:35:30.847675    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeca8464_8321_4884_a828_5c4e97af337f.slice/crio-6cde123c3e55f46230d09603a51cafec52d420492c3c2a1f33529c7227645e7a WatchSource:0}: Error finding container 6cde123c3e55f46230d09603a51cafec52d420492c3c2a1f33529c7227645e7a: Status 404 returned error can't find the container with id 6cde123c3e55f46230d09603a51cafec52d420492c3c2a1f33529c7227645e7a
Jul 27 20:35:31.231462 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:31.231427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerStarted","Data":"6cde123c3e55f46230d09603a51cafec52d420492c3c2a1f33529c7227645e7a"}
Jul 27 20:35:33.805636 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:33.805596    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:33.805926 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:33.805672    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:33.805926 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:33.805707    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:34.245265 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:34.245229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerStarted","Data":"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"}
Jul 27 20:35:34.265118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:34.265065    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podStartSLOduration=1.3094691680000001 podStartE2EDuration="4.265049166s" totalImagesPullingTime="2.955579998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:34.263982693 +0000 UTC m=+1905.457761117" watchObservedRunningTime="2026-07-27 20:35:34.265049166 +0000 UTC m=+1905.458827547"
Jul 27 20:35:34.693343 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:34.693309    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:34.697688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:34.697664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:35.249122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.249087    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:35.250005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.249988    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:35.905544 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.905512    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:35:35.908792 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.908770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:35.911877 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.911857    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-73a591cd-serving-cert\""
Jul 27 20:35:35.912073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.912059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-flzfl\""
Jul 27 20:35:35.919586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.919564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:35:35.979601 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.979569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:35.979729 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.979629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jffn\" (UniqueName: \"kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:35.979729 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:35.979707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.080856 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.080819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.081068 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.080896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jffn\" (UniqueName: \"kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.081068 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.080951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.081219 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:35:36.081067    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-serving-cert: secret "maas-api-e2e-migrate-73a591cd-serving-cert" not found
Jul 27 20:35:36.081219 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:35:36.081147    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls podName:ccc03c97-2662-481b-8093-1d0674ad85aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:36.581125772 +0000 UTC m=+1907.774904136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls") pod "maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" (UID: "ccc03c97-2662-481b-8093-1d0674ad85aa") : secret "maas-api-e2e-migrate-73a591cd-serving-cert" not found
Jul 27 20:35:36.081538 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.081517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.089918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.089898    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jffn\" (UniqueName: \"kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.586588 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.586551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.588953 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.588922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") pod \"maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.817935 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.817899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:36.943785 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:36.943760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:35:36.946546 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:35:36.946517    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc03c97_2662_481b_8093_1d0674ad85aa.slice/crio-40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91 WatchSource:0}: Error finding container 40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91: Status 404 returned error can't find the container with id 40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91
Jul 27 20:35:37.257455 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:37.257420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" event={"ID":"ccc03c97-2662-481b-8093-1d0674ad85aa","Type":"ContainerStarted","Data":"40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91"}
Jul 27 20:35:38.263134 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:38.263102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" event={"ID":"ccc03c97-2662-481b-8093-1d0674ad85aa","Type":"ContainerStarted","Data":"adafb49e26d2095f11bc933e3c36663ee1bb16227718a5b17cef40b6cd0f51f8"}
Jul 27 20:35:38.263532 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:38.263166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:38.281641 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:38.281597    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" podStartSLOduration=2.785420212 podStartE2EDuration="3.281581013s" totalImagesPullingTime="496.160801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:38.279946346 +0000 UTC m=+1909.473724730" watchObservedRunningTime="2026-07-27 20:35:38.281581013 +0000 UTC m=+1909.475359397"
Jul 27 20:35:44.272756 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:44.272724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:35:50.472161 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:50.472125    2575 patch_prober.go:28] interesting pod/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": read tcp 10.132.0.2:60284->10.132.0.22:15021: read: connection reset by peer" start-of-body=
Jul 27 20:35:50.472560 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:50.472210    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": read tcp 10.132.0.2:60284->10.132.0.22:15021: read: connection reset by peer"
Jul 27 20:35:51.317235 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.317204    2575 generic.go:356] "Generic (PLEG): container finished" podID="feca8464-8321-4884-a828-5c4e97af337f" containerID="83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd" exitCode=0
Jul 27 20:35:51.317414 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.317264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerDied","Data":"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"}
Jul 27 20:35:51.317675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.317655    2575 scope.go:117] "RemoveContainer" containerID="83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"
Jul 27 20:35:51.318640 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.318610    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:51.318738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.318675    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:51.318738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:51.318706    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:35:52.322909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:52.322878    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerStarted","Data":"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"}
Jul 27 20:35:52.693062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:52.693020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:52.693310 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:52.693290    2575 patch_prober.go:28] interesting pod/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Jul 27 20:35:52.693365 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:52.693344    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Jul 27 20:35:53.693576 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:53.693536    2575 patch_prober.go:28] interesting pod/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Jul 27 20:35:53.693970 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:53.693595    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Jul 27 20:35:54.692999 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:54.692965    2575 patch_prober.go:28] interesting pod/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Jul 27 20:35:54.693223 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:54.693019    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Jul 27 20:35:55.693757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:55.693717    2575 patch_prober.go:28] interesting pod/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Jul 27 20:35:55.694250 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:55.693769    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Jul 27 20:35:56.696781 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:56.696748    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:56.697254 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:56.697118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:35:56.697702 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:35:56.697684    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:36:11.143797 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.143764    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:36:11.145304 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.144711    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" podUID="ccc03c97-2662-481b-8093-1d0674ad85aa" containerName="maas-api" containerID="cri-o://adafb49e26d2095f11bc933e3c36663ee1bb16227718a5b17cef40b6cd0f51f8" gracePeriod=30
Jul 27 20:36:11.400496 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.400432    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccc03c97-2662-481b-8093-1d0674ad85aa" containerID="adafb49e26d2095f11bc933e3c36663ee1bb16227718a5b17cef40b6cd0f51f8" exitCode=0
Jul 27 20:36:11.400600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.400499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" event={"ID":"ccc03c97-2662-481b-8093-1d0674ad85aa","Type":"ContainerDied","Data":"adafb49e26d2095f11bc933e3c36663ee1bb16227718a5b17cef40b6cd0f51f8"}
Jul 27 20:36:11.400600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.400549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc" event={"ID":"ccc03c97-2662-481b-8093-1d0674ad85aa","Type":"ContainerDied","Data":"40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91"}
Jul 27 20:36:11.400600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.400567    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40589b771b0b8a6d0c579281d8e581886256f5c39f33d037f1a87686d9470d91"
Jul 27 20:36:11.404549 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.404531    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:36:11.588845 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.588815    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca\") pod \"ccc03c97-2662-481b-8093-1d0674ad85aa\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") "
Jul 27 20:36:11.589035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.588858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jffn\" (UniqueName: \"kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn\") pod \"ccc03c97-2662-481b-8093-1d0674ad85aa\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") "
Jul 27 20:36:11.589035 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.588950    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") pod \"ccc03c97-2662-481b-8093-1d0674ad85aa\" (UID: \"ccc03c97-2662-481b-8093-1d0674ad85aa\") "
Jul 27 20:36:11.589259 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.589206    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccc03c97-2662-481b-8093-1d0674ad85aa" (UID: "ccc03c97-2662-481b-8093-1d0674ad85aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:11.590977 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.590953    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn" (OuterVolumeSpecName: "kube-api-access-2jffn") pod "ccc03c97-2662-481b-8093-1d0674ad85aa" (UID: "ccc03c97-2662-481b-8093-1d0674ad85aa"). InnerVolumeSpecName "kube-api-access-2jffn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:11.591079 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.590973    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccc03c97-2662-481b-8093-1d0674ad85aa" (UID: "ccc03c97-2662-481b-8093-1d0674ad85aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:36:11.690062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.689972    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jffn\" (UniqueName: \"kubernetes.io/projected/ccc03c97-2662-481b-8093-1d0674ad85aa-kube-api-access-2jffn\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.690062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.690006    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc03c97-2662-481b-8093-1d0674ad85aa-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.690062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:11.690020    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03c97-2662-481b-8093-1d0674ad85aa-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:12.404562 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:12.404532    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"
Jul 27 20:36:12.424989 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:12.424960    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:36:12.428558 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:12.428536    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-73a591cd-8687ccdc67-8v5cc"]
Jul 27 20:36:13.422313 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:13.422281    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc03c97-2662-481b-8093-1d0674ad85aa" path="/var/lib/kubelet/pods/ccc03c97-2662-481b-8093-1d0674ad85aa/volumes"
Jul 27 20:36:15.936526 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:15.936492    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:36:15.936948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:15.936719    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy" containerID="cri-o://8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43" gracePeriod=30
Jul 27 20:36:16.725360 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.725331    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:16.725620 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.725608    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc03c97-2662-481b-8093-1d0674ad85aa" containerName="maas-api"
Jul 27 20:36:16.725668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.725622    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc03c97-2662-481b-8093-1d0674ad85aa" containerName="maas-api"
Jul 27 20:36:16.725702 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.725671    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc03c97-2662-481b-8093-1d0674ad85aa" containerName="maas-api"
Jul 27 20:36:16.728951 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.728933    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.731498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.731474    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-35ff59c0-openshift-default-dockercfg-cdhlw\""
Jul 27 20:36:16.743681 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.743654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:16.823327 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823327 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823330    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwhv\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.823826 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.823619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924001 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.923971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwhv\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924634 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924634 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924705 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924693    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.924801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.924774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.926504 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.926487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.926746 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.926727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.931330 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.931304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:16.931459 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:16.931443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwhv\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv\") pod \"e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") " pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:17.038652 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.038579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:17.164932 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.164820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:17.167252 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:36:17.167225    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937f990c_59cf_4231_b73c_ad913d827cfe.slice/crio-82297df6d1f3aa3cd42fb0f44a9391b47ee7d0211e207f3f54194ac83e1c056b WatchSource:0}: Error finding container 82297df6d1f3aa3cd42fb0f44a9391b47ee7d0211e207f3f54194ac83e1c056b: Status 404 returned error can't find the container with id 82297df6d1f3aa3cd42fb0f44a9391b47ee7d0211e207f3f54194ac83e1c056b
Jul 27 20:36:17.169734 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.169702    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:17.169835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.169776    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:17.169835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.169824    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:17.425345 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.425313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerStarted","Data":"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"}
Jul 27 20:36:17.425505 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.425364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerStarted","Data":"82297df6d1f3aa3cd42fb0f44a9391b47ee7d0211e207f3f54194ac83e1c056b"}
Jul 27 20:36:17.443488 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:17.443442    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podStartSLOduration=1.443427899 podStartE2EDuration="1.443427899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:17.442772706 +0000 UTC m=+1948.636551114" watchObservedRunningTime="2026-07-27 20:36:17.443427899 +0000 UTC m=+1948.637206279"
Jul 27 20:36:18.039770 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:18.039734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:18.044551 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:18.044527    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:18.429012 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:18.428975    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:18.430005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:18.429984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:21.187109 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.187088    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:36:21.259439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259378    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sgf6\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259439 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259592 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259592 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259519    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259624    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259715 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259668    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259715 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259802 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259802 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo\") pod \"feca8464-8321-4884-a828-5c4e97af337f\" (UID: \"feca8464-8321-4884-a828-5c4e97af337f\") "
Jul 27 20:36:21.259802 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259764    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:21.260066 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.259997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:21.260066 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.260028    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.260229 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.260105    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:21.260229 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.260144    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:21.260353 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.260330    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data" (OuterVolumeSpecName: "istio-data") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:21.261783 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.261760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:21.261864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.261780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token" (OuterVolumeSpecName: "istio-token") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:21.261864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.261780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6" (OuterVolumeSpecName: "kube-api-access-7sgf6") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "kube-api-access-7sgf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:21.261864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.261840    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "feca8464-8321-4884-a828-5c4e97af337f" (UID: "feca8464-8321-4884-a828-5c4e97af337f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:36:21.360921 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360900    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.360921 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360919    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360928    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360936    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360944    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feca8464-8321-4884-a828-5c4e97af337f-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360954    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feca8464-8321-4884-a828-5c4e97af337f-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360965    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feca8464-8321-4884-a828-5c4e97af337f-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.361041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.360977    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sgf6\" (UniqueName: \"kubernetes.io/projected/feca8464-8321-4884-a828-5c4e97af337f-kube-api-access-7sgf6\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:21.441393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.441368    2575 generic.go:356] "Generic (PLEG): container finished" podID="feca8464-8321-4884-a828-5c4e97af337f" containerID="8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43" exitCode=0
Jul 27 20:36:21.441510 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.441414    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"
Jul 27 20:36:21.441510 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.441448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerDied","Data":"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"}
Jul 27 20:36:21.441510 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.441498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv" event={"ID":"feca8464-8321-4884-a828-5c4e97af337f","Type":"ContainerDied","Data":"6cde123c3e55f46230d09603a51cafec52d420492c3c2a1f33529c7227645e7a"}
Jul 27 20:36:21.441611 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.441521    2575 scope.go:117] "RemoveContainer" containerID="8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"
Jul 27 20:36:21.452700 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.452682    2575 scope.go:117] "RemoveContainer" containerID="83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"
Jul 27 20:36:21.460559 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.460540    2575 scope.go:117] "RemoveContainer" containerID="8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"
Jul 27 20:36:21.461063 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:36:21.461017    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43\": container with ID starting with 8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43 not found: ID does not exist" containerID="8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"
Jul 27 20:36:21.461190 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.461074    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43"} err="failed to get container status \"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43\": rpc error: code = NotFound desc = could not find container \"8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43\": container with ID starting with 8de46568ee9126a47342345eac227bb9a95356fd8f45f7e7975132844ba25b43 not found: ID does not exist"
Jul 27 20:36:21.461190 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.461095    2575 scope.go:117] "RemoveContainer" containerID="83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"
Jul 27 20:36:21.461497 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:36:21.461470    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd\": container with ID starting with 83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd not found: ID does not exist" containerID="83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"
Jul 27 20:36:21.461613 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.461505    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd"} err="failed to get container status \"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd\": rpc error: code = NotFound desc = could not find container \"83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd\": container with ID starting with 83f416d3e91fabc25cea16c9f171850ad52d54b81407d2ecaf895f929ed36fcd not found: ID does not exist"
Jul 27 20:36:21.463132 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.463114    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:36:21.466918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:21.466898    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-73a591cd-gw-openshift-default-84fb864dcb-lgssv"]
Jul 27 20:36:23.423447 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:23.423415    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feca8464-8321-4884-a828-5c4e97af337f" path="/var/lib/kubelet/pods/feca8464-8321-4884-a828-5c4e97af337f/volumes"
Jul 27 20:36:34.463111 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.462924    2575 patch_prober.go:28] interesting pod/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:36:34.463111 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.463005    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:36:34.491940 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.491916    2575 generic.go:356] "Generic (PLEG): container finished" podID="937f990c-59cf-4231-b73c-ad913d827cfe" containerID="fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73" exitCode=0
Jul 27 20:36:34.492038 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.491983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerDied","Data":"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"}
Jul 27 20:36:34.492368 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.492355    2575 scope.go:117] "RemoveContainer" containerID="fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"
Jul 27 20:36:34.493317 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.493291    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:34.493383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.493353    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:34.493419 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:34.493384    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:35.497570 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:35.497528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerStarted","Data":"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"}
Jul 27 20:36:36.039645 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:36.039597    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:36.039872 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:36.039740    2575 patch_prober.go:28] interesting pod/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 20:36:36.039872 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:36.039802    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 20:36:37.039592 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:37.039545    2575 patch_prober.go:28] interesting pod/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 20:36:37.040101 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:37.039632    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 20:36:38.039618 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:38.039567    2575 patch_prober.go:28] interesting pod/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 20:36:38.040116 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:38.039679    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 20:36:39.039764 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:39.039723    2575 patch_prober.go:28] interesting pod/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 20:36:39.040393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:39.040357    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 20:36:40.042225 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:40.042196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:40.042631 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:40.042484    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:40.043149 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:40.043131    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:45.491151 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:45.491062    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:45.491624 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:45.491316    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy" containerID="cri-o://f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77" gracePeriod=30
Jul 27 20:36:46.259074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259040    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:36:46.259387 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259374    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:36:46.259442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259389    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:36:46.259442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259403    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:36:46.259442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259409    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:36:46.259531 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.259451    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:36:46.261745 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.261726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.264306 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.264283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0d589065-openshift-default-dockercfg-gpzcl\""
Jul 27 20:36:46.278931 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.278907    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:36:46.371851 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.371810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.371851 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.371858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxh8l\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.371851 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.371877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.371947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.371971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.372007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.372075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.372132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.372337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.372201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473542 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxh8l\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.473713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474070 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.473855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474070 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.474028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474172 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.474108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474257 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.474242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474399 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.474377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.474461 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.474410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.475919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.475896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.476079 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.476060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.481539 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.481517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.481629 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.481551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxh8l\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l\") pod \"e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") " pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.571987 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.571925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:46.701389 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.701365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:36:46.703677 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:36:46.703651    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829c987a_750a_4dfd_bdbb_b890782f206e.slice/crio-6db7c0d3b8d3b7fffd6f09eafd3505d195eafc1237361bb7cb08beffa2c564a0 WatchSource:0}: Error finding container 6db7c0d3b8d3b7fffd6f09eafd3505d195eafc1237361bb7cb08beffa2c564a0: Status 404 returned error can't find the container with id 6db7c0d3b8d3b7fffd6f09eafd3505d195eafc1237361bb7cb08beffa2c564a0
Jul 27 20:36:46.706224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.706189    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:46.706299 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.706259    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:46.706299 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:46.706287    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:36:47.548336 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:47.548295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerStarted","Data":"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"}
Jul 27 20:36:47.548500 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:47.548365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerStarted","Data":"6db7c0d3b8d3b7fffd6f09eafd3505d195eafc1237361bb7cb08beffa2c564a0"}
Jul 27 20:36:47.569731 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:47.569681    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" podStartSLOduration=1.569664685 podStartE2EDuration="1.569664685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:47.568095735 +0000 UTC m=+1978.761874144" watchObservedRunningTime="2026-07-27 20:36:47.569664685 +0000 UTC m=+1978.763443065"
Jul 27 20:36:47.572460 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:47.572437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:47.577633 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:47.577612    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:48.552407 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:48.552370    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:48.553402 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:48.553380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:36:50.741327 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.741305    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:50.814609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814544    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814609 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814604    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814809 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814809 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814677    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814809 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814718    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814809 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814748    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zwhv\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.814809 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814789    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.815049 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814831    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket\") pod \"937f990c-59cf-4231-b73c-ad913d827cfe\" (UID: \"937f990c-59cf-4231-b73c-ad913d827cfe\") "
Jul 27 20:36:50.815049 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.814831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:50.815153 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.815060    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:50.815153 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.815086    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.815375 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.815328    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:50.815375 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.815360    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:50.815656 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.815634    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:50.816793 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.816774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:50.816901 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.816880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:50.817156 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.817138    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv" (OuterVolumeSpecName: "kube-api-access-9zwhv") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "kube-api-access-9zwhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:50.817261 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.817151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "937f990c-59cf-4231-b73c-ad913d827cfe" (UID: "937f990c-59cf-4231-b73c-ad913d827cfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:36:50.915470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915431    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937f990c-59cf-4231-b73c-ad913d827cfe-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915461    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915472    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937f990c-59cf-4231-b73c-ad913d827cfe-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915481    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915719 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915489    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zwhv\" (UniqueName: \"kubernetes.io/projected/937f990c-59cf-4231-b73c-ad913d827cfe-kube-api-access-9zwhv\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915719 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915498    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915719 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915506    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:50.915719 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:50.915514    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937f990c-59cf-4231-b73c-ad913d827cfe-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:36:51.567501 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.567466    2575 generic.go:356] "Generic (PLEG): container finished" podID="937f990c-59cf-4231-b73c-ad913d827cfe" containerID="f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77" exitCode=0
Jul 27 20:36:51.567713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.567510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerDied","Data":"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"}
Jul 27 20:36:51.567713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.567564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62" event={"ID":"937f990c-59cf-4231-b73c-ad913d827cfe","Type":"ContainerDied","Data":"82297df6d1f3aa3cd42fb0f44a9391b47ee7d0211e207f3f54194ac83e1c056b"}
Jul 27 20:36:51.567713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.567595    2575 scope.go:117] "RemoveContainer" containerID="f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"
Jul 27 20:36:51.567713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.567652    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"
Jul 27 20:36:51.576215 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.576167    2575 scope.go:117] "RemoveContainer" containerID="fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"
Jul 27 20:36:51.583774 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.583756    2575 scope.go:117] "RemoveContainer" containerID="f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"
Jul 27 20:36:51.584081 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.584060    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:51.584169 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:36:51.584057    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77\": container with ID starting with f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77 not found: ID does not exist" containerID="f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"
Jul 27 20:36:51.584169 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.584126    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77"} err="failed to get container status \"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77\": rpc error: code = NotFound desc = could not find container \"f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77\": container with ID starting with f5f6edb74cf6eb06a44f1e545dbf86b48e2bc78647e972bcff7bfce99f3a9c77 not found: ID does not exist"
Jul 27 20:36:51.584169 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.584152    2575 scope.go:117] "RemoveContainer" containerID="fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"
Jul 27 20:36:51.584432 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:36:51.584416    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73\": container with ID starting with fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73 not found: ID does not exist" containerID="fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"
Jul 27 20:36:51.584499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.584437    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73"} err="failed to get container status \"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73\": rpc error: code = NotFound desc = could not find container \"fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73\": container with ID starting with fb39beb12758911263f24ec7e98aaf24f511de01525c56458a481fc7c985ff73 not found: ID does not exist"
Jul 27 20:36:51.587136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:51.587114    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-35ff59c0-openshift-default-7949bf5c4b-f7b62"]
Jul 27 20:36:53.423428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:36:53.423390    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" path="/var/lib/kubelet/pods/937f990c-59cf-4231-b73c-ad913d827cfe/volumes"
Jul 27 20:37:02.612797 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.612764    2575 generic.go:356] "Generic (PLEG): container finished" podID="829c987a-750a-4dfd-bdbb-b890782f206e" containerID="cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c" exitCode=0
Jul 27 20:37:02.613286 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.612849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerDied","Data":"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"}
Jul 27 20:37:02.613382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.613366    2575 scope.go:117] "RemoveContainer" containerID="cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"
Jul 27 20:37:02.614398 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.614372    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:37:02.614462 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.614437    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:37:02.614502 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:02.614468    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:37:03.553042 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:03.552999    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:03.618389 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:03.618354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerStarted","Data":"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"}
Jul 27 20:37:04.572203 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:04.572154    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:04.573278 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:04.573254    2575 patch_prober.go:28] interesting pod/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 27 20:37:04.573395 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:04.573300    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 27 20:37:05.572655 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:05.572623    2575 patch_prober.go:28] interesting pod/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 27 20:37:05.573050 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:05.572677    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 27 20:37:06.572442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:06.572408    2575 patch_prober.go:28] interesting pod/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 27 20:37:06.572616 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:06.572460    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 27 20:37:07.577032 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:07.577003    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:07.577414 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:07.577363    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:07.578128 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:07.578113    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:29.028966 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:29.028933    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:37:29.029443 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:29.029189    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy" containerID="cri-o://25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105" gracePeriod=30
Jul 27 20:37:34.272928 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.272902    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:34.378830 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.378802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.378869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.378907    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.378932    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379010 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.378988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379242 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379010    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxh8l\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379242 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379242 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379071    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379242 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379101    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs\") pod \"829c987a-750a-4dfd-bdbb-b890782f206e\" (UID: \"829c987a-750a-4dfd-bdbb-b890782f206e\") "
Jul 27 20:37:34.379430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:37:34.379430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379304    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:37:34.379540 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379484    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.379540 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379504    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.379639 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379609    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:37:34.379919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.379872    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:37:34.380597 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.380566    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data" (OuterVolumeSpecName: "istio-data") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:37:34.381097 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.381072    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:37:34.381413 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.381391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:37:34.381413 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.381406    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l" (OuterVolumeSpecName: "kube-api-access-pxh8l") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "kube-api-access-pxh8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:37:34.381524 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.381444    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token" (OuterVolumeSpecName: "istio-token") pod "829c987a-750a-4dfd-bdbb-b890782f206e" (UID: "829c987a-750a-4dfd-bdbb-b890782f206e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:37:34.480430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480406    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxh8l\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-kube-api-access-pxh8l\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480430 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480428    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/829c987a-750a-4dfd-bdbb-b890782f206e-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480439    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480447    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480456    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/829c987a-750a-4dfd-bdbb-b890782f206e-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480464    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/829c987a-750a-4dfd-bdbb-b890782f206e-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.480573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.480472    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/829c987a-750a-4dfd-bdbb-b890782f206e-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:37:34.750407 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.750323    2575 generic.go:356] "Generic (PLEG): container finished" podID="829c987a-750a-4dfd-bdbb-b890782f206e" containerID="25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105" exitCode=0
Jul 27 20:37:34.750407 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.750361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerDied","Data":"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"}
Jul 27 20:37:34.750407 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.750371    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"
Jul 27 20:37:34.750647 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.750409    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th" event={"ID":"829c987a-750a-4dfd-bdbb-b890782f206e","Type":"ContainerDied","Data":"6db7c0d3b8d3b7fffd6f09eafd3505d195eafc1237361bb7cb08beffa2c564a0"}
Jul 27 20:37:34.750647 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.750436    2575 scope.go:117] "RemoveContainer" containerID="25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"
Jul 27 20:37:34.759271 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.759255    2575 scope.go:117] "RemoveContainer" containerID="cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"
Jul 27 20:37:34.766237 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.766219    2575 scope.go:117] "RemoveContainer" containerID="25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"
Jul 27 20:37:34.766467 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:37:34.766448    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105\": container with ID starting with 25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105 not found: ID does not exist" containerID="25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"
Jul 27 20:37:34.766520 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.766474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105"} err="failed to get container status \"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105\": rpc error: code = NotFound desc = could not find container \"25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105\": container with ID starting with 25118b82b1f3e5d535dc18263351ab75cc81c1ff6220f554fc7b8129c70c2105 not found: ID does not exist"
Jul 27 20:37:34.766520 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.766491    2575 scope.go:117] "RemoveContainer" containerID="cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"
Jul 27 20:37:34.766730 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:37:34.766712    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c\": container with ID starting with cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c not found: ID does not exist" containerID="cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"
Jul 27 20:37:34.766773 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.766737    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c"} err="failed to get container status \"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c\": rpc error: code = NotFound desc = could not find container \"cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c\": container with ID starting with cb76a242c5c7af5be6720155e27010f22eebf2c639e75911a936c17b9984ce2c not found: ID does not exist"
Jul 27 20:37:34.771608 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.771589    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:37:34.774693 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:34.774673    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0d589065-openshift-default-6f9ffb585b-7d6th"]
Jul 27 20:37:35.422642 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:37:35.422610    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" path="/var/lib/kubelet/pods/829c987a-750a-4dfd-bdbb-b890782f206e/volumes"
Jul 27 20:39:19.671858 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.671828    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672120    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672132    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672147    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672152    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672159    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672164    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672229    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672238    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="feca8464-8321-4884-a828-5c4e97af337f" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672243    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672250    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.672303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.672255    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="829c987a-750a-4dfd-bdbb-b890782f206e" containerName="istio-proxy"
Jul 27 20:39:19.674877 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.674862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.677032 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.677013    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5b6e45fe-openshift-default-dockercfg-vqxv9\""
Jul 27 20:39:19.686732 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.686704    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:39:19.691498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691591 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8l84\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691591 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691667 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691706 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691741 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691774 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.691871 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.691847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793138 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8l84\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793138 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793382 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793834 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.793834 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.793798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.794073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.794053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.795699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.795677    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.795832 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.795751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.804548 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.804524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.805151 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.805133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8l84\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84\") pod \"e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") " pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:19.984392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:19.984297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:20.118500 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:20.118474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:39:20.120307 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:39:20.120281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a8e17e_6adb_452a_99c2_5ec4afbcbc45.slice/crio-d957fb5a3510952117a0da079f08fee133c9cb4c3c80d7df3717d955f3035f3e WatchSource:0}: Error finding container d957fb5a3510952117a0da079f08fee133c9cb4c3c80d7df3717d955f3035f3e: Status 404 returned error can't find the container with id d957fb5a3510952117a0da079f08fee133c9cb4c3c80d7df3717d955f3035f3e
Jul 27 20:39:20.122645 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:20.122611    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:20.122717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:20.122679    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:20.122717 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:20.122707    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:20.152533 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:20.152511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerStarted","Data":"d957fb5a3510952117a0da079f08fee133c9cb4c3c80d7df3717d955f3035f3e"}
Jul 27 20:39:21.158876 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:21.158838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerStarted","Data":"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"}
Jul 27 20:39:21.192353 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:21.192299    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" podStartSLOduration=2.192283138 podStartE2EDuration="2.192283138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:21.191228481 +0000 UTC m=+2132.385006883" watchObservedRunningTime="2026-07-27 20:39:21.192283138 +0000 UTC m=+2132.386061518"
Jul 27 20:39:21.985102 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:21.985064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:21.989860 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:21.989835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:22.163713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:22.163678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:22.164818 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:22.164796    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:23.308977 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.308947    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:23.309357 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.309234    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:23.309357 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.309246    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="937f990c-59cf-4231-b73c-ad913d827cfe" containerName="istio-proxy"
Jul 27 20:39:23.312149 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.312128    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.314463 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.314439    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5b6e45fe-serving-cert\""
Jul 27 20:39:23.314701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.314685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-flzfl\""
Jul 27 20:39:23.324625 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.324600    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:23.422191 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.422156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.422346 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.422224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.422346 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.422259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.523030 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.522998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.523228 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.523046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.523228 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.523084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.523364 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:39:23.523236    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-serving-cert: secret "maas-api-e2e-mt-5b6e45fe-serving-cert" not found
Jul 27 20:39:23.523364 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:39:23.523298    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls podName:3afd0545-7c5d-478a-8aa6-6c5097ade5e5 nodeName:}" failed. No retries permitted until 2026-07-27 20:39:24.02327894 +0000 UTC m=+2135.217057300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls") pod "maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" (UID: "3afd0545-7c5d-478a-8aa6-6c5097ade5e5") : secret "maas-api-e2e-mt-5b6e45fe-serving-cert" not found
Jul 27 20:39:23.523727 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.523701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:23.531587 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:23.531564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:24.026547 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:24.026505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:24.028844 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:24.028818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") pod \"maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:24.222517 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:24.222490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:24.348628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:24.348606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:24.351086 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:39:24.351065    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afd0545_7c5d_478a_8aa6_6c5097ade5e5.slice/crio-a31e0fc20212720c730323eb903a9422a939fdd86d4416d9020c628cd331eb2e WatchSource:0}: Error finding container a31e0fc20212720c730323eb903a9422a939fdd86d4416d9020c628cd331eb2e: Status 404 returned error can't find the container with id a31e0fc20212720c730323eb903a9422a939fdd86d4416d9020c628cd331eb2e
Jul 27 20:39:24.805909 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:39:24.805881    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afd0545_7c5d_478a_8aa6_6c5097ade5e5.slice/crio-f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 20:39:25.176109 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:25.176074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" event={"ID":"3afd0545-7c5d-478a-8aa6-6c5097ade5e5","Type":"ContainerStarted","Data":"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"}
Jul 27 20:39:25.176282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:25.176133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" event={"ID":"3afd0545-7c5d-478a-8aa6-6c5097ade5e5","Type":"ContainerStarted","Data":"a31e0fc20212720c730323eb903a9422a939fdd86d4416d9020c628cd331eb2e"}
Jul 27 20:39:25.176282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:25.176215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:25.194544 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:25.194151    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" podStartSLOduration=1.785681241 podStartE2EDuration="2.194132421s" totalImagesPullingTime="408.45118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:25.192393515 +0000 UTC m=+2136.386171896" watchObservedRunningTime="2026-07-27 20:39:25.194132421 +0000 UTC m=+2136.387910801"
Jul 27 20:39:31.186443 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:31.186413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:35.216992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.216911    2575 generic.go:356] "Generic (PLEG): container finished" podID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerID="973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019" exitCode=0
Jul 27 20:39:35.216992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.216972    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerDied","Data":"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"}
Jul 27 20:39:35.217481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.217345    2575 scope.go:117] "RemoveContainer" containerID="973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"
Jul 27 20:39:35.218281 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.218252    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:35.218388 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.218321    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:35.218388 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:35.218353    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:39:36.222937 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:36.222901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerStarted","Data":"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"}
Jul 27 20:39:36.985144 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:36.985102    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:36.986076 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:36.986036    2575 patch_prober.go:28] interesting pod/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jul 27 20:39:36.986218 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:36.986101    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jul 27 20:39:37.164428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:37.164388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:37.985197 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:37.985156    2575 patch_prober.go:28] interesting pod/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jul 27 20:39:37.985565 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:37.985233    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jul 27 20:39:38.985463 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:38.985423    2575 patch_prober.go:28] interesting pod/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jul 27 20:39:38.985919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:38.985498    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jul 27 20:39:39.990073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:39.990026    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:39.991224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:39.991202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:39:45.764757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:45.764679    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:45.765202 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:45.764934    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" podUID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" containerName="maas-api" containerID="cri-o://f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c" gracePeriod=30
Jul 27 20:39:46.008219 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.008167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:46.107769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.107679    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca\") pod \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") "
Jul 27 20:39:46.107769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.107722    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q\") pod \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") "
Jul 27 20:39:46.107986 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.107811    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") pod \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\" (UID: \"3afd0545-7c5d-478a-8aa6-6c5097ade5e5\") "
Jul 27 20:39:46.108039 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.108013    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3afd0545-7c5d-478a-8aa6-6c5097ade5e5" (UID: "3afd0545-7c5d-478a-8aa6-6c5097ade5e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:39:46.109786 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.109765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3afd0545-7c5d-478a-8aa6-6c5097ade5e5" (UID: "3afd0545-7c5d-478a-8aa6-6c5097ade5e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:39:46.109884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.109862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q" (OuterVolumeSpecName: "kube-api-access-8ns2q") pod "3afd0545-7c5d-478a-8aa6-6c5097ade5e5" (UID: "3afd0545-7c5d-478a-8aa6-6c5097ade5e5"). InnerVolumeSpecName "kube-api-access-8ns2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:39:46.209370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.209339    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.209370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.209364    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.209370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.209374    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/3afd0545-7c5d-478a-8aa6-6c5097ade5e5-kube-api-access-8ns2q\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.268770 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.268739    2575 generic.go:356] "Generic (PLEG): container finished" podID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" containerID="f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c" exitCode=0
Jul 27 20:39:46.268948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.268788    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"
Jul 27 20:39:46.268948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.268833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" event={"ID":"3afd0545-7c5d-478a-8aa6-6c5097ade5e5","Type":"ContainerDied","Data":"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"}
Jul 27 20:39:46.268948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.268903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx" event={"ID":"3afd0545-7c5d-478a-8aa6-6c5097ade5e5","Type":"ContainerDied","Data":"a31e0fc20212720c730323eb903a9422a939fdd86d4416d9020c628cd331eb2e"}
Jul 27 20:39:46.268948 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.268932    2575 scope.go:117] "RemoveContainer" containerID="f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"
Jul 27 20:39:46.276900 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.276881    2575 scope.go:117] "RemoveContainer" containerID="f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"
Jul 27 20:39:46.277168 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:39:46.277149    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c\": container with ID starting with f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c not found: ID does not exist" containerID="f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"
Jul 27 20:39:46.277240 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.277189    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c"} err="failed to get container status \"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c\": rpc error: code = NotFound desc = could not find container \"f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c\": container with ID starting with f2c58b45fce4e825ff6b59c12fa9ec948ab59f37a9378d59d7ae9e89d82e932c not found: ID does not exist"
Jul 27 20:39:46.288813 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.288738    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:46.290094 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:46.290075    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b6e45fe-5f7b4bbb98-jt6gx"]
Jul 27 20:39:47.423442 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:47.423411    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" path="/var/lib/kubelet/pods/3afd0545-7c5d-478a-8aa6-6c5097ade5e5/volumes"
Jul 27 20:39:57.701783 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:57.701750    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:39:57.702261 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:39:57.701987    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy" containerID="cri-o://3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288" gracePeriod=30
Jul 27 20:40:02.940795 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:02.940759    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:40:03.058812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.058812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.058812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058800    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058820    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8l84\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059074 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.058986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert\") pod \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\" (UID: \"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45\") "
Jul 27 20:40:03.059394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059136    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:40:03.059394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059260    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.059394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059273    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:40:03.059558 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:40:03.059672 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059555    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:40:03.059757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.059735    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:40:03.061085 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.061060    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:40:03.061085 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.061066    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:40:03.061394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.061373    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:40:03.061464 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.061446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84" (OuterVolumeSpecName: "kube-api-access-c8l84") pod "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" (UID: "d0a8e17e-6adb-452a-99c2-5ec4afbcbc45"). InnerVolumeSpecName "kube-api-access-c8l84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:40:03.160117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160080    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160112    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160121    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160117 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160129    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160138    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8l84\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-kube-api-access-c8l84\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160146    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160153    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.160347 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.160161    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:40:03.342626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.342543    2575 generic.go:356] "Generic (PLEG): container finished" podID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerID="3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288" exitCode=0
Jul 27 20:40:03.342626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.342578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerDied","Data":"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"}
Jul 27 20:40:03.342626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.342586    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"
Jul 27 20:40:03.342626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.342621    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq" event={"ID":"d0a8e17e-6adb-452a-99c2-5ec4afbcbc45","Type":"ContainerDied","Data":"d957fb5a3510952117a0da079f08fee133c9cb4c3c80d7df3717d955f3035f3e"}
Jul 27 20:40:03.342880 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.342644    2575 scope.go:117] "RemoveContainer" containerID="3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"
Jul 27 20:40:03.351561 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.351545    2575 scope.go:117] "RemoveContainer" containerID="973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"
Jul 27 20:40:03.358769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.358750    2575 scope.go:117] "RemoveContainer" containerID="3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"
Jul 27 20:40:03.358997 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:40:03.358976    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288\": container with ID starting with 3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288 not found: ID does not exist" containerID="3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"
Jul 27 20:40:03.359046 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.359004    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288"} err="failed to get container status \"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288\": rpc error: code = NotFound desc = could not find container \"3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288\": container with ID starting with 3811e9f7862ecf44c1cb718a9ef95397b79f1d87b9873678c1b60a92c04b8288 not found: ID does not exist"
Jul 27 20:40:03.359046 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.359019    2575 scope.go:117] "RemoveContainer" containerID="973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"
Jul 27 20:40:03.359249 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:40:03.359233    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019\": container with ID starting with 973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019 not found: ID does not exist" containerID="973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"
Jul 27 20:40:03.359302 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.359253    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019"} err="failed to get container status \"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019\": rpc error: code = NotFound desc = could not find container \"973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019\": container with ID starting with 973db1090250f54b8a2c638e6e82b101582d8928a16971ba6906298e7ce90019 not found: ID does not exist"
Jul 27 20:40:03.371340 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.371315    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:40:03.379747 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.379725    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5b6e45fe-openshift-default-77958b9d8-qjqzq"]
Jul 27 20:40:03.423005 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:03.422967    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" path="/var/lib/kubelet/pods/d0a8e17e-6adb-452a-99c2-5ec4afbcbc45/volumes"
Jul 27 20:40:19.766514 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766478    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766737    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766747    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766766    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" containerName="maas-api"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766771    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" containerName="maas-api"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766818    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afd0545-7c5d-478a-8aa6-6c5097ade5e5" containerName="maas-api"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766826    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:19.766892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.766832    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:19.769602 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.769585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.774648 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.774621    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-030d0aef-openshift-default-dockercfg-lmpb7\""
Jul 27 20:40:19.784824 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.784919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.784919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrbp\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.784919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.784919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.785052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.785052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.784984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.785052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.785012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.785052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.785034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.795728 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.795708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:40:19.885929 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.885896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.885951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.885977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrbp\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886110 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886460 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886460 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886460 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886460 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886651 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886703 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886785 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.886953 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.886936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.888221 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.888198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.888629 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.888613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.912402 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.912374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrbp\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:19.914299 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:19.914272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token\") pod \"e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") " pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:20.079424 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.079330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:20.217464 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.217437    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:40:20.218655 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:40:20.218627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a616f4_8d27_4fe4_a5fc_996fb09efc72.slice/crio-26a3165b2a4b29b93c90210977c6533715f3978d18a6915bab0b1895454fc3b3 WatchSource:0}: Error finding container 26a3165b2a4b29b93c90210977c6533715f3978d18a6915bab0b1895454fc3b3: Status 404 returned error can't find the container with id 26a3165b2a4b29b93c90210977c6533715f3978d18a6915bab0b1895454fc3b3
Jul 27 20:40:20.220611 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.220577    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:20.220683 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.220644    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:20.220683 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.220669    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:20.415317 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.415276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerStarted","Data":"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"}
Jul 27 20:40:20.415502 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.415340    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerStarted","Data":"26a3165b2a4b29b93c90210977c6533715f3978d18a6915bab0b1895454fc3b3"}
Jul 27 20:40:20.461573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:20.461518    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podStartSLOduration=1.461501082 podStartE2EDuration="1.461501082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:20.460097256 +0000 UTC m=+2191.653875651" watchObservedRunningTime="2026-07-27 20:40:20.461501082 +0000 UTC m=+2191.655279522"
Jul 27 20:40:21.079574 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:21.079535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:21.084355 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:21.084329    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:21.422626 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:21.422596    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:21.422786 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:21.422657    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:23.097551 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.097516    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:40:23.097912 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.097804    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:23.097912 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.097817    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8e17e-6adb-452a-99c2-5ec4afbcbc45" containerName="istio-proxy"
Jul 27 20:40:23.099893 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.099878    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.104913 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.104880    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-030d0aef-serving-cert\""
Jul 27 20:40:23.106134 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.106110    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-flzfl\""
Jul 27 20:40:23.110359 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.110331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxxm\" (UniqueName: \"kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.110479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.110419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.110546 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.110524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.123545 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.123519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:40:23.210922 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.210894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.211055 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.210949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxxm\" (UniqueName: \"kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.211055 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.210981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.211550 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.211530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.213352 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.213331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.287385 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.287360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxxm\" (UniqueName: \"kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm\") pod \"maas-api-e2e-mt-030d0aef-884bf6479-ds2cp\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.412621 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.412591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:23.578986 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.578961    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:40:23.580787 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:40:23.580759    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1c98ae_82d8_4527_9bad_7547ea24e046.slice/crio-0cf480dc9c0904e438cb040ca402dc9b46c0c52db471c7b4d72c5229d4e2b71c WatchSource:0}: Error finding container 0cf480dc9c0904e438cb040ca402dc9b46c0c52db471c7b4d72c5229d4e2b71c: Status 404 returned error can't find the container with id 0cf480dc9c0904e438cb040ca402dc9b46c0c52db471c7b4d72c5229d4e2b71c
Jul 27 20:40:23.582224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:23.582207    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:40:24.432867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:24.432836    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" event={"ID":"ad1c98ae-82d8-4527-9bad-7547ea24e046","Type":"ContainerStarted","Data":"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"}
Jul 27 20:40:24.433265 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:24.432887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" event={"ID":"ad1c98ae-82d8-4527-9bad-7547ea24e046","Type":"ContainerStarted","Data":"0cf480dc9c0904e438cb040ca402dc9b46c0c52db471c7b4d72c5229d4e2b71c"}
Jul 27 20:40:24.433265 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:24.432951    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:24.469613 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:24.469562    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" podStartSLOduration=1.028606479 podStartE2EDuration="1.46954786s" totalImagesPullingTime="440.941381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:24.46845038 +0000 UTC m=+2195.662228762" watchObservedRunningTime="2026-07-27 20:40:24.46954786 +0000 UTC m=+2195.663326240"
Jul 27 20:40:30.451525 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:30.451478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:40:36.421028 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.420991    2575 patch_prober.go:28] interesting pod/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 27 20:40:36.421470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.421057    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 27 20:40:36.483002 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.482974    2575 generic.go:356] "Generic (PLEG): container finished" podID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerID="09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50" exitCode=0
Jul 27 20:40:36.483154 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.483037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerDied","Data":"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"}
Jul 27 20:40:36.483420 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.483399    2575 scope.go:117] "RemoveContainer" containerID="09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"
Jul 27 20:40:36.484406 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.484377    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:36.484477 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.484445    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:36.484525 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:36.484478    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:40:37.489337 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:37.489302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerStarted","Data":"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"}
Jul 27 20:40:38.080515 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:38.080477    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:38.080760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:38.080737    2575 patch_prober.go:28] interesting pod/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 27 20:40:38.080812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:38.080788    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 27 20:40:39.079929 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:39.079891    2575 patch_prober.go:28] interesting pod/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 27 20:40:39.080371 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:39.079950    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 27 20:40:40.080533 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:40.080493    2575 patch_prober.go:28] interesting pod/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 27 20:40:40.080951 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:40.080551    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 27 20:40:41.080650 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:41.080608    2575 patch_prober.go:28] interesting pod/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 27 20:40:41.081045 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:41.080674    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 27 20:40:42.083601 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:42.083569    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:42.084000 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:42.083823    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:40:42.084496 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:40:42.084478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:41:17.128396 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.128320    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:41:17.128933 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.128538    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" podUID="ad1c98ae-82d8-4527-9bad-7547ea24e046" containerName="maas-api" containerID="cri-o://f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594" gracePeriod=30
Jul 27 20:41:17.368857 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.368821    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:41:17.472165 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.472083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls\") pod \"ad1c98ae-82d8-4527-9bad-7547ea24e046\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") "
Jul 27 20:41:17.472165 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.472122    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpxxm\" (UniqueName: \"kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm\") pod \"ad1c98ae-82d8-4527-9bad-7547ea24e046\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") "
Jul 27 20:41:17.472165 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.472144    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca\") pod \"ad1c98ae-82d8-4527-9bad-7547ea24e046\" (UID: \"ad1c98ae-82d8-4527-9bad-7547ea24e046\") "
Jul 27 20:41:17.472590 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.472565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad1c98ae-82d8-4527-9bad-7547ea24e046" (UID: "ad1c98ae-82d8-4527-9bad-7547ea24e046"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:41:17.474237 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.474208    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad1c98ae-82d8-4527-9bad-7547ea24e046" (UID: "ad1c98ae-82d8-4527-9bad-7547ea24e046"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:41:17.474341 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.474326    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm" (OuterVolumeSpecName: "kube-api-access-gpxxm") pod "ad1c98ae-82d8-4527-9bad-7547ea24e046" (UID: "ad1c98ae-82d8-4527-9bad-7547ea24e046"). InnerVolumeSpecName "kube-api-access-gpxxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:17.573465 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.573438    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1c98ae-82d8-4527-9bad-7547ea24e046-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.573465 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.573465    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpxxm\" (UniqueName: \"kubernetes.io/projected/ad1c98ae-82d8-4527-9bad-7547ea24e046-kube-api-access-gpxxm\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.573631 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.573474    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1c98ae-82d8-4527-9bad-7547ea24e046-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.657835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.657804    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad1c98ae-82d8-4527-9bad-7547ea24e046" containerID="f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594" exitCode=0
Jul 27 20:41:17.658007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.657848    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"
Jul 27 20:41:17.658007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.657885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" event={"ID":"ad1c98ae-82d8-4527-9bad-7547ea24e046","Type":"ContainerDied","Data":"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"}
Jul 27 20:41:17.658007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.657936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp" event={"ID":"ad1c98ae-82d8-4527-9bad-7547ea24e046","Type":"ContainerDied","Data":"0cf480dc9c0904e438cb040ca402dc9b46c0c52db471c7b4d72c5229d4e2b71c"}
Jul 27 20:41:17.658007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.657962    2575 scope.go:117] "RemoveContainer" containerID="f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"
Jul 27 20:41:17.666465 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.666437    2575 scope.go:117] "RemoveContainer" containerID="f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"
Jul 27 20:41:17.666792 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:41:17.666717    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594\": container with ID starting with f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594 not found: ID does not exist" containerID="f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"
Jul 27 20:41:17.666792 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.666758    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594"} err="failed to get container status \"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594\": rpc error: code = NotFound desc = could not find container \"f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594\": container with ID starting with f4f850ff5a37c397d4d9b146b7ad880c82f2c2d97a8f0f344a625aef17dbb594 not found: ID does not exist"
Jul 27 20:41:17.678803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.678781    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:41:17.685896 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:17.685877    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-030d0aef-884bf6479-ds2cp"]
Jul 27 20:41:19.423023 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:19.422990    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1c98ae-82d8-4527-9bad-7547ea24e046" path="/var/lib/kubelet/pods/ad1c98ae-82d8-4527-9bad-7547ea24e046/volumes"
Jul 27 20:41:49.395720 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:41:49.395686    2575 scope.go:117] "RemoveContainer" containerID="adafb49e26d2095f11bc933e3c36663ee1bb16227718a5b17cef40b6cd0f51f8"
Jul 27 20:42:20.259037 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:20.258997    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:42:20.259470 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:20.259227    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy" containerID="cri-o://1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd" gracePeriod=30
Jul 27 20:42:25.503707 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.503683    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:42:25.537791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.537791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.537791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537798    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537922    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nrbp\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.537967    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538164 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538006    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538164 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538164 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538071    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:25.538164 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538113    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs\") pod \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\" (UID: \"56a616f4-8d27-4fe4-a5fc-996fb09efc72\") "
Jul 27 20:42:25.538399 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538270    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:25.538455 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538434    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:25.539054 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538530    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:42:25.539054 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538539    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.539054 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538580    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.539054 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538598    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.539054 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.538821    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data" (OuterVolumeSpecName: "istio-data") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:25.540499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.540473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp" (OuterVolumeSpecName: "kube-api-access-4nrbp") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "kube-api-access-4nrbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:25.540499 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.540489    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token" (OuterVolumeSpecName: "istio-token") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:25.541103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.541077    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:42:25.541200 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.541107    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56a616f4-8d27-4fe4-a5fc-996fb09efc72" (UID: "56a616f4-8d27-4fe4-a5fc-996fb09efc72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:25.639440 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639398    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.639440 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639430    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.639440 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639443    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.639686 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639454    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nrbp\" (UniqueName: \"kubernetes.io/projected/56a616f4-8d27-4fe4-a5fc-996fb09efc72-kube-api-access-4nrbp\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.639686 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639467    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.639686 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.639478    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a616f4-8d27-4fe4-a5fc-996fb09efc72-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:42:25.927828 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.927791    2575 generic.go:356] "Generic (PLEG): container finished" podID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerID="1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd" exitCode=0
Jul 27 20:42:25.927995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.927835    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"
Jul 27 20:42:25.927995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.927873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerDied","Data":"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"}
Jul 27 20:42:25.927995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.927929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n" event={"ID":"56a616f4-8d27-4fe4-a5fc-996fb09efc72","Type":"ContainerDied","Data":"26a3165b2a4b29b93c90210977c6533715f3978d18a6915bab0b1895454fc3b3"}
Jul 27 20:42:25.927995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.927952    2575 scope.go:117] "RemoveContainer" containerID="1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"
Jul 27 20:42:25.936669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.936655    2575 scope.go:117] "RemoveContainer" containerID="09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"
Jul 27 20:42:25.943863 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.943849    2575 scope.go:117] "RemoveContainer" containerID="1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"
Jul 27 20:42:25.944106 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:42:25.944090    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd\": container with ID starting with 1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd not found: ID does not exist" containerID="1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"
Jul 27 20:42:25.944141 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.944116    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd"} err="failed to get container status \"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd\": rpc error: code = NotFound desc = could not find container \"1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd\": container with ID starting with 1e1279838ab623eeaf0111151a297acc06e337d1667d6743e62b7de46e5ddecd not found: ID does not exist"
Jul 27 20:42:25.944141 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.944133    2575 scope.go:117] "RemoveContainer" containerID="09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"
Jul 27 20:42:25.944393 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:42:25.944374    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50\": container with ID starting with 09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50 not found: ID does not exist" containerID="09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"
Jul 27 20:42:25.944428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.944398    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50"} err="failed to get container status \"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50\": rpc error: code = NotFound desc = could not find container \"09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50\": container with ID starting with 09798559137ba51fc9c2d459ab070c6455758e990b002007fdb48aecf81fba50 not found: ID does not exist"
Jul 27 20:42:25.950077 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.950055    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:42:25.953739 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:25.953717    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-030d0aef-openshift-default-6ddcbbf7dd-vz88n"]
Jul 27 20:42:27.422959 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:42:27.422929    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" path="/var/lib/kubelet/pods/56a616f4-8d27-4fe4-a5fc-996fb09efc72/volumes"
Jul 27 20:43:16.614356 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614322    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614598    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614609    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614625    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1c98ae-82d8-4527-9bad-7547ea24e046" containerName="maas-api"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614631    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1c98ae-82d8-4527-9bad-7547ea24e046" containerName="maas-api"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614681    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614689    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:16.614812 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.614696    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1c98ae-82d8-4527-9bad-7547ea24e046" containerName="maas-api"
Jul 27 20:43:16.617536 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.617516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.619673 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.619652    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a12508-openshift-default-dockercfg-5n6d8\""
Jul 27 20:43:16.629548 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.629520    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:43:16.667063 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667063 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667297 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667297 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzkn\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667361 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.667457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.667409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768099 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768099 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzkn\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.768942 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.768925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.770511 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.770494    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.770736 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.770717    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.776114 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.776088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.776507 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.776480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzkn\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn\") pod \"e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") " pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:16.927086 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:16.927054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:17.060113 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.060085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:43:17.062070 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:43:17.062041    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaadc873_650e_43e3_8031_5ea6e884745d.slice/crio-5390637340f4b93944414959ce9a5791f33acfce251aeaecdd28cf755b0e2efe WatchSource:0}: Error finding container 5390637340f4b93944414959ce9a5791f33acfce251aeaecdd28cf755b0e2efe: Status 404 returned error can't find the container with id 5390637340f4b93944414959ce9a5791f33acfce251aeaecdd28cf755b0e2efe
Jul 27 20:43:17.064487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.064452    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:17.064591 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.064514    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:17.064591 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.064543    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:17.122100 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.122075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerStarted","Data":"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"}
Jul 27 20:43:17.122219 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.122123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerStarted","Data":"5390637340f4b93944414959ce9a5791f33acfce251aeaecdd28cf755b0e2efe"}
Jul 27 20:43:17.143481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.143423    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podStartSLOduration=1.143405249 podStartE2EDuration="1.143405249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:17.14144226 +0000 UTC m=+2368.335220681" watchObservedRunningTime="2026-07-27 20:43:17.143405249 +0000 UTC m=+2368.337183630"
Jul 27 20:43:17.927461 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:17.927407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:18.932383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:18.932351    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:19.130524 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:19.130493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:19.131462 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:19.131439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:24.358108 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.358076    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:43:24.358586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.358519    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:24.358586 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.358538    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a616f4-8d27-4fe4-a5fc-996fb09efc72" containerName="istio-proxy"
Jul 27 20:43:24.361595 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.361575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.364310 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.364287    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-eb7a86-openshift-default-dockercfg-nhg5d\""
Jul 27 20:43:24.379376 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.379354    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:43:24.434692 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.434888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.434888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.434888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.434888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.435062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bctx\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.435062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.434981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.435062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.435000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.435062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.435042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.535835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.535794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.535835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.535836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536090 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.535867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536090 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.535982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bctx\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536090 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536282 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536501 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536501 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536629 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536604    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536698 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.536894 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.536875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.538150 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.538131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.538450 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.538434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.546978 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.546954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.547369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.547349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bctx\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx\") pod \"e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") " pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.671960 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.671931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:24.803985 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.803955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:43:24.806513 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:43:24.806482    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7341019f_5948_4cd3_b834_a92eb5b50123.slice/crio-14cc71c2db5c8e66d59006a2972753b8cfd189cf2173df956a9f0ba7726c5dcc WatchSource:0}: Error finding container 14cc71c2db5c8e66d59006a2972753b8cfd189cf2173df956a9f0ba7726c5dcc: Status 404 returned error can't find the container with id 14cc71c2db5c8e66d59006a2972753b8cfd189cf2173df956a9f0ba7726c5dcc
Jul 27 20:43:24.808678 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.808645    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:24.808757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.808715    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:24.808757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:24.808751    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:25.154339 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.154304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerStarted","Data":"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"}
Jul 27 20:43:25.154523 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.154358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerStarted","Data":"14cc71c2db5c8e66d59006a2972753b8cfd189cf2173df956a9f0ba7726c5dcc"}
Jul 27 20:43:25.173737 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.173678    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podStartSLOduration=1.173656092 podStartE2EDuration="1.173656092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:25.17254026 +0000 UTC m=+2376.366318642" watchObservedRunningTime="2026-07-27 20:43:25.173656092 +0000 UTC m=+2376.367434474"
Jul 27 20:43:25.673020 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.672985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:25.674472 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.674446    2575 patch_prober.go:28] interesting pod/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 27 20:43:25.674608 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:25.674501    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 27 20:43:26.677729 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:26.677697    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:27.163244 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:27.163211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:27.164288 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:27.164263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:34.131810 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.131769    2575 patch_prober.go:28] interesting pod/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 27 20:43:34.132372 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.131852    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 27 20:43:34.194562 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.194531    2575 generic.go:356] "Generic (PLEG): container finished" podID="daadc873-650e-43e3-8031-5ea6e884745d" containerID="ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0" exitCode=0
Jul 27 20:43:34.194732 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.194605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerDied","Data":"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"}
Jul 27 20:43:34.195018 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.195005    2575 scope.go:117] "RemoveContainer" containerID="ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"
Jul 27 20:43:34.196115 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.196088    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:34.196168 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.196158    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:34.196233 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:34.196213    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:35.200687 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:35.200650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerStarted","Data":"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"}
Jul 27 20:43:35.927361 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:35.927318    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:35.927592 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:35.927569    2575 patch_prober.go:28] interesting pod/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 27 20:43:35.927666 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:35.927647    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 27 20:43:36.928523 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:36.928478    2575 patch_prober.go:28] interesting pod/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 27 20:43:36.929043 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:36.928546    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 27 20:43:37.928092 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:37.928045    2575 patch_prober.go:28] interesting pod/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 27 20:43:37.928349 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:37.928117    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 27 20:43:38.928461 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:38.928423    2575 patch_prober.go:28] interesting pod/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 27 20:43:38.929076 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:38.929041    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 27 20:43:39.931893 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:39.931865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:39.932357 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:39.932167    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:39.932964 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:39.932942    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:43:41.226909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.226820    2575 generic.go:356] "Generic (PLEG): container finished" podID="7341019f-5948-4cd3-b834-a92eb5b50123" containerID="5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0" exitCode=0
Jul 27 20:43:41.226909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.226897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerDied","Data":"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"}
Jul 27 20:43:41.227386 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.227373    2575 scope.go:117] "RemoveContainer" containerID="5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"
Jul 27 20:43:41.228365 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.228342    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:41.228432 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.228405    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:41.228472 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:41.228438    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:43:42.163444 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:42.163390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:42.235434 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:42.235396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerStarted","Data":"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"}
Jul 27 20:43:42.673061 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:42.673009    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:42.674098 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:42.674074    2575 patch_prober.go:28] interesting pod/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 27 20:43:42.674158 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:42.674124    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 27 20:43:43.673120 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:43.673076    2575 patch_prober.go:28] interesting pod/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 27 20:43:43.673567 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:43.673141    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 27 20:43:44.672668 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:44.672637    2575 patch_prober.go:28] interesting pod/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 27 20:43:44.672833 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:44.672689    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 27 20:43:45.672366 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:45.672325    2575 patch_prober.go:28] interesting pod/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 27 20:43:45.672786 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:45.672410    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 27 20:43:46.676697 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:46.676669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:46.677172 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:46.676944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:43:46.677725 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:43:46.677709    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:44:58.739131 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:44:58.739099    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:44:58.739578 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:44:58.739327    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy" containerID="cri-o://2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8" gracePeriod=30
Jul 27 20:45:03.975617 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:03.975592    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:45:04.007762 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.007762 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.007762 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgzkn\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007779    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007810    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007837    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007895    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007936    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008014 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.007986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs\") pod \"daadc873-650e-43e3-8031-5ea6e884745d\" (UID: \"daadc873-650e-43e3-8031-5ea6e884745d\") "
Jul 27 20:45:04.008332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.008054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:04.008332 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.008255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:04.008434 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.008399    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:04.008487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.008458    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.008832 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.008796    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data" (OuterVolumeSpecName: "istio-data") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:04.009028 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.009003    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:45:04.010543 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.010521    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token" (OuterVolumeSpecName: "istio-token") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:04.010713 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.010688    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn" (OuterVolumeSpecName: "kube-api-access-bgzkn") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "kube-api-access-bgzkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:04.010782 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.010732    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:45:04.010782 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.010732    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "daadc873-650e-43e3-8031-5ea6e884745d" (UID: "daadc873-650e-43e3-8031-5ea6e884745d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:04.109456 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109421    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgzkn\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-kube-api-access-bgzkn\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109456 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109449    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109456 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109458    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daadc873-650e-43e3-8031-5ea6e884745d-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109456 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109467    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109475    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109483    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daadc873-650e-43e3-8031-5ea6e884745d-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109491    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daadc873-650e-43e3-8031-5ea6e884745d-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.109722 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.109500    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daadc873-650e-43e3-8031-5ea6e884745d-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:04.569893 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.569855    2575 generic.go:356] "Generic (PLEG): container finished" podID="daadc873-650e-43e3-8031-5ea6e884745d" containerID="2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8" exitCode=0
Jul 27 20:45:04.570088 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.569905    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"
Jul 27 20:45:04.570088 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.569936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerDied","Data":"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"}
Jul 27 20:45:04.570088 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.569990    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5" event={"ID":"daadc873-650e-43e3-8031-5ea6e884745d","Type":"ContainerDied","Data":"5390637340f4b93944414959ce9a5791f33acfce251aeaecdd28cf755b0e2efe"}
Jul 27 20:45:04.570088 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.570012    2575 scope.go:117] "RemoveContainer" containerID="2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"
Jul 27 20:45:04.578959 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.578939    2575 scope.go:117] "RemoveContainer" containerID="ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"
Jul 27 20:45:04.586395 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.586378    2575 scope.go:117] "RemoveContainer" containerID="2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"
Jul 27 20:45:04.586629 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:45:04.586607    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8\": container with ID starting with 2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8 not found: ID does not exist" containerID="2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"
Jul 27 20:45:04.586699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.586640    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8"} err="failed to get container status \"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8\": rpc error: code = NotFound desc = could not find container \"2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8\": container with ID starting with 2cb91909707e2d9b03464e6abfd2faa40deca318800f57912ac14855d8243cc8 not found: ID does not exist"
Jul 27 20:45:04.586699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.586663    2575 scope.go:117] "RemoveContainer" containerID="ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"
Jul 27 20:45:04.586883 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:45:04.586867    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0\": container with ID starting with ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0 not found: ID does not exist" containerID="ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"
Jul 27 20:45:04.586922 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.586889    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0"} err="failed to get container status \"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0\": rpc error: code = NotFound desc = could not find container \"ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0\": container with ID starting with ef9973724e2cbc0e5f44129237ea362d437578de1a29ac152704b49aa78c9bb0 not found: ID does not exist"
Jul 27 20:45:04.591856 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.591834    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:45:04.595189 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:04.595158    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a12508-openshift-default-65c8fb78bd-hqdf5"]
Jul 27 20:45:05.429987 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:05.429944    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daadc873-650e-43e3-8031-5ea6e884745d" path="/var/lib/kubelet/pods/daadc873-650e-43e3-8031-5ea6e884745d/volumes"
Jul 27 20:45:20.640564 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:20.640531    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:45:20.640990 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:20.640796    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy" containerID="cri-o://bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e" gracePeriod=30
Jul 27 20:45:21.543300 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:45:21.543562 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543549    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.543562 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543563    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.543675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543577    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.543675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543583    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.543675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543660    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.543675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.543669    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="daadc873-650e-43e3-8031-5ea6e884745d" containerName="istio-proxy"
Jul 27 20:45:21.546369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.546350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.549118 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.549096    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3f4799-openshift-default-dockercfg-jb59v\""
Jul 27 20:45:21.560680 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.560656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:45:21.665508 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dld\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665508 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.665984 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.665756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766490 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dld\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766490 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766712 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766712 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766712 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766712 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.766908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767013 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767013 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.766965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767165 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.767135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767299 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.767147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767351 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.767307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.767419 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.767406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.768938 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.768899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.769152 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.769135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.774669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.774643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.774801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.774779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dld\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld\") pod \"e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") " pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.857279 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.857194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:21.983922 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.983898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:45:21.986153 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:45:21.986115    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd960fde_62eb_4c3b_9e14_926c3a5e7c11.slice/crio-239cd1a332a27a51430a5fcfdde95211b1f56f9f8f0c2788c97e46a74a02706d WatchSource:0}: Error finding container 239cd1a332a27a51430a5fcfdde95211b1f56f9f8f0c2788c97e46a74a02706d: Status 404 returned error can't find the container with id 239cd1a332a27a51430a5fcfdde95211b1f56f9f8f0c2788c97e46a74a02706d
Jul 27 20:45:21.988575 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.988544    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:21.988645 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.988608    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:21.988645 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:21.988633    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:22.646379 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:22.646347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerStarted","Data":"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"}
Jul 27 20:45:22.646589 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:22.646397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerStarted","Data":"239cd1a332a27a51430a5fcfdde95211b1f56f9f8f0c2788c97e46a74a02706d"}
Jul 27 20:45:22.670168 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:22.670123    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podStartSLOduration=1.6700945699999998 podStartE2EDuration="1.67009457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:22.668087398 +0000 UTC m=+2493.861865778" watchObservedRunningTime="2026-07-27 20:45:22.67009457 +0000 UTC m=+2493.863872950"
Jul 27 20:45:22.858100 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:22.858064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:23.862889 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:23.862860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:24.656256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:24.656227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:24.657336 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:24.657310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:25.884778 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:25.884753    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:45:26.007364 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007364 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007364 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007335    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007364 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007350    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007453    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bctx\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.007751 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs\") pod \"7341019f-5948-4cd3-b834-a92eb5b50123\" (UID: \"7341019f-5948-4cd3-b834-a92eb5b50123\") "
Jul 27 20:45:26.008012 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007799    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:26.008012 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007973    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:26.008012 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.007996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:26.008169 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.008146    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:45:26.008381 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.008361    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data" (OuterVolumeSpecName: "istio-data") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:26.009642 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.009619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token" (OuterVolumeSpecName: "istio-token") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:26.009739 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.009640    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx" (OuterVolumeSpecName: "kube-api-access-2bctx") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "kube-api-access-2bctx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:26.009909 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.009883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:45:26.010006 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.009883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7341019f-5948-4cd3-b834-a92eb5b50123" (UID: "7341019f-5948-4cd3-b834-a92eb5b50123"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:45:26.108509 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108479    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108509 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108503    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108509 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108512    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108520    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7341019f-5948-4cd3-b834-a92eb5b50123-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108528    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108537    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7341019f-5948-4cd3-b834-a92eb5b50123-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108544    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108552    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bctx\" (UniqueName: \"kubernetes.io/projected/7341019f-5948-4cd3-b834-a92eb5b50123-kube-api-access-2bctx\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.108738 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.108560    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7341019f-5948-4cd3-b834-a92eb5b50123-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:45:26.665124 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.665085    2575 generic.go:356] "Generic (PLEG): container finished" podID="7341019f-5948-4cd3-b834-a92eb5b50123" containerID="bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e" exitCode=0
Jul 27 20:45:26.665342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.665141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"
Jul 27 20:45:26.665342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.665172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerDied","Data":"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"}
Jul 27 20:45:26.665342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.665255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n" event={"ID":"7341019f-5948-4cd3-b834-a92eb5b50123","Type":"ContainerDied","Data":"14cc71c2db5c8e66d59006a2972753b8cfd189cf2173df956a9f0ba7726c5dcc"}
Jul 27 20:45:26.665342 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.665277    2575 scope.go:117] "RemoveContainer" containerID="bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"
Jul 27 20:45:26.673945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.673928    2575 scope.go:117] "RemoveContainer" containerID="5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"
Jul 27 20:45:26.681058 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.681042    2575 scope.go:117] "RemoveContainer" containerID="bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"
Jul 27 20:45:26.681419 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:45:26.681400    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e\": container with ID starting with bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e not found: ID does not exist" containerID="bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"
Jul 27 20:45:26.681602 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.681428    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e"} err="failed to get container status \"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e\": rpc error: code = NotFound desc = could not find container \"bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e\": container with ID starting with bbd41140f2d2eead5b7a6b4a96a81212c67cdf627fc4320ecb78264c562ebd7e not found: ID does not exist"
Jul 27 20:45:26.681602 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.681444    2575 scope.go:117] "RemoveContainer" containerID="5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"
Jul 27 20:45:26.681693 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:45:26.681666    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0\": container with ID starting with 5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0 not found: ID does not exist" containerID="5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"
Jul 27 20:45:26.681729 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.681689    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0"} err="failed to get container status \"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0\": rpc error: code = NotFound desc = could not find container \"5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0\": container with ID starting with 5dfb5261b860cc1d2f5f273d692cdefa358151802e139e134bafe2543da523b0 not found: ID does not exist"
Jul 27 20:45:26.684781 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.684760    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:45:26.687426 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:26.687405    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-eb7a86-openshift-default-689c7fbf58-dnh8n"]
Jul 27 20:45:27.423427 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:27.423397    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" path="/var/lib/kubelet/pods/7341019f-5948-4cd3-b834-a92eb5b50123/volumes"
Jul 27 20:45:29.849003 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.848972    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:45:29.849467 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.849258    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:45:29.849467 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.849270    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:45:29.849467 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.849343    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:45:29.849467 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.849351    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:45:29.853923 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.853902    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:29.856378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.856351    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5a7e30-openshift-default-dockercfg-rs8l4\""
Jul 27 20:45:29.864227 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:29.864205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:45:30.044497 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044497 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044723 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044914 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zvxd\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.044914 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.044752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146007 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.145964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146260 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146260 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zvxd\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146260 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146428 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.146842 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.146817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.148338 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.148305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.148614 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.148589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.148798 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.148778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.149119 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.149096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.151553 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.149860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.153443 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.153417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.156734 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.156709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.156834 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.156784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zvxd\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd\") pod \"e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") " pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.163598 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.163576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:30.291675 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.291633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:45:30.294474 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:45:30.294447    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87524d75_b132_4358_8221_abd9bb70a630.slice/crio-af060d07cf7ac2dc90aa8d05e9545f34123cecbf8b0363085c38222c8d491b0f WatchSource:0}: Error finding container af060d07cf7ac2dc90aa8d05e9545f34123cecbf8b0363085c38222c8d491b0f: Status 404 returned error can't find the container with id af060d07cf7ac2dc90aa8d05e9545f34123cecbf8b0363085c38222c8d491b0f
Jul 27 20:45:30.296457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.296425    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:30.296546 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.296488    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:30.296546 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.296516    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:30.683393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.683358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerStarted","Data":"e9e62ba51f55d0d2f83af0e4f3647aae7ae2aa3165f6ee1ff2ec14caebafad2c"}
Jul 27 20:45:30.683587 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.683418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerStarted","Data":"af060d07cf7ac2dc90aa8d05e9545f34123cecbf8b0363085c38222c8d491b0f"}
Jul 27 20:45:30.702708 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:30.702653    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podStartSLOduration=1.7026345250000001 podStartE2EDuration="1.702634525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:30.701282864 +0000 UTC m=+2501.895061265" watchObservedRunningTime="2026-07-27 20:45:30.702634525 +0000 UTC m=+2501.896412904"
Jul 27 20:45:31.164036 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:31.164006    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:31.168823 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:31.168799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:31.687009 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:31.686982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:31.687817 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:31.687799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:39.962584 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:39.962530    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": read tcp 10.132.0.2:47050->10.132.0.32:15021: read: connection reset by peer" start-of-body=
Jul 27 20:45:39.962960 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:39.962610    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": read tcp 10.132.0.2:47050->10.132.0.32:15021: read: connection reset by peer"
Jul 27 20:45:40.723669 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.723640    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerID="4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00" exitCode=0
Jul 27 20:45:40.723835 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.723714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerDied","Data":"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"}
Jul 27 20:45:40.724089 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.724075    2575 scope.go:117] "RemoveContainer" containerID="4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"
Jul 27 20:45:40.725170 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.725137    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:40.725261 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.725237    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:40.725301 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:40.725272    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:41.730408 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:41.730353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerStarted","Data":"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"}
Jul 27 20:45:41.857487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:41.857397    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:41.857724 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:41.857702    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 20:45:41.857805 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:41.857755    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 20:45:42.858336 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:42.858289    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 20:45:42.858862 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:42.858368    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 20:45:43.858414 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:43.858368    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 20:45:43.859028 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:43.858993    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 20:45:44.858132 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:44.858074    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 20:45:44.858355 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:44.858154    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 20:45:45.861801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:45.861766    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:45.862269 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:45.862038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:45.862819 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:45.862803    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:45:47.727369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:47.727329    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:45:47.727793 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:47.727401    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:45:49.774249 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.774146    2575 generic.go:356] "Generic (PLEG): container finished" podID="87524d75-b132-4358-8221-abd9bb70a630" containerID="e9e62ba51f55d0d2f83af0e4f3647aae7ae2aa3165f6ee1ff2ec14caebafad2c" exitCode=0
Jul 27 20:45:49.774249 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.774227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerDied","Data":"e9e62ba51f55d0d2f83af0e4f3647aae7ae2aa3165f6ee1ff2ec14caebafad2c"}
Jul 27 20:45:49.774661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.774591    2575 scope.go:117] "RemoveContainer" containerID="e9e62ba51f55d0d2f83af0e4f3647aae7ae2aa3165f6ee1ff2ec14caebafad2c"
Jul 27 20:45:49.775584 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.775551    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:49.775705 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.775635    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:49.775705 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:49.775679    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:45:50.780962 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:50.780927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerStarted","Data":"c30d7ddac53984c441abe8f4a7884b47fddfea409ff0b92b05de5f00ec536617"}
Jul 27 20:45:51.164359 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:51.164318    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:51.164584 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:51.164560    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 27 20:45:51.164661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:51.164616    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 27 20:45:52.164915 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:52.164857    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 27 20:45:52.165361 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:52.164938    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 27 20:45:53.165028 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:53.164991    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 27 20:45:53.165450 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:53.165047    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 27 20:45:54.164093 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:54.164054    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 27 20:45:54.164318 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:54.164115    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 27 20:45:55.167729 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:55.167695    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:55.168211 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:55.168065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:45:55.168731 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:45:55.168714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:46:11.886133 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:11.886088    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:46:11.886646 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:11.886332    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" containerID="cri-o://c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe" gracePeriod=30
Jul 27 20:46:15.864198 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:15.864126    2575 patch_prober.go:28] interesting pod/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:46:15.864583 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:15.864233    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:46:17.129256 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.129231    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:46:17.172490 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172490 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172458    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74dld\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.172699 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172681    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.173018 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172704    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data\") pod \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\" (UID: \"dd960fde-62eb-4c3b-9e14-926c3a5e7c11\") "
Jul 27 20:46:17.173018 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:17.173018 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.172866    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:17.173212 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.173038    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.173212 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.173060    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.173212 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.173020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:17.173212 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.173151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:17.173711 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.173689    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:17.174778 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.174749    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:46:17.174886 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.174776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:17.175047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.175021    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:17.175047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.175034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld" (OuterVolumeSpecName: "kube-api-access-74dld") pod "dd960fde-62eb-4c3b-9e14-926c3a5e7c11" (UID: "dd960fde-62eb-4c3b-9e14-926c3a5e7c11"). InnerVolumeSpecName "kube-api-access-74dld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:17.273725 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273687    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74dld\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-kube-api-access-74dld\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273725 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273717    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273725 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273726    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273957 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273738    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273957 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273747    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273957 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273755    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.273957 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.273762    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd960fde-62eb-4c3b-9e14-926c3a5e7c11-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:17.893208 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.893160    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerID="c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe" exitCode=0
Jul 27 20:46:17.893391 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.893227    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"
Jul 27 20:46:17.893391 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.893249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerDied","Data":"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"}
Jul 27 20:46:17.893391 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.893304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc" event={"ID":"dd960fde-62eb-4c3b-9e14-926c3a5e7c11","Type":"ContainerDied","Data":"239cd1a332a27a51430a5fcfdde95211b1f56f9f8f0c2788c97e46a74a02706d"}
Jul 27 20:46:17.893391 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.893326    2575 scope.go:117] "RemoveContainer" containerID="c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"
Jul 27 20:46:17.901533 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.901514    2575 scope.go:117] "RemoveContainer" containerID="4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"
Jul 27 20:46:17.908444 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.908420    2575 scope.go:117] "RemoveContainer" containerID="c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"
Jul 27 20:46:17.908718 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:46:17.908693    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe\": container with ID starting with c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe not found: ID does not exist" containerID="c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"
Jul 27 20:46:17.908801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.908730    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe"} err="failed to get container status \"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe\": rpc error: code = NotFound desc = could not find container \"c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe\": container with ID starting with c8e0e87346d5082863cde87b75b9558bf869085b11114365152d8803c80271fe not found: ID does not exist"
Jul 27 20:46:17.908801 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.908775    2575 scope.go:117] "RemoveContainer" containerID="4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"
Jul 27 20:46:17.909701 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:46:17.909680    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00\": container with ID starting with 4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00 not found: ID does not exist" containerID="4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"
Jul 27 20:46:17.909858 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.909705    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00"} err="failed to get container status \"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00\": rpc error: code = NotFound desc = could not find container \"4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00\": container with ID starting with 4437175bb4669a7f3cdab18d05a721e114a3dd2158cba785af12f0e656c08d00 not found: ID does not exist"
Jul 27 20:46:17.910449 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.910429    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:46:17.916954 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:17.916931    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3f4799-openshift-default-56dcfb8d56-pfbbc"]
Jul 27 20:46:19.422877 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:19.422845    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" path="/var/lib/kubelet/pods/dd960fde-62eb-4c3b-9e14-926c3a5e7c11/volumes"
Jul 27 20:46:38.790065 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:38.790025    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:46:38.790465 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:38.790340    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" containerID="cri-o://c30d7ddac53984c441abe8f4a7884b47fddfea409ff0b92b05de5f00ec536617" gracePeriod=30
Jul 27 20:46:39.676918 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.676886    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 20:46:39.677234 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677219    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:39.677234 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677234    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:39.677383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677267    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:39.677383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677274    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:39.677383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677283    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:46:39.677383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677289    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7341019f-5948-4cd3-b834-a92eb5b50123" containerName="istio-proxy"
Jul 27 20:46:39.677383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.677341    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:39.679224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.679203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.681815 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.681797    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4af3f5-openshift-default-dockercfg-88znt\""
Jul 27 20:46:39.692251 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.692230    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 20:46:39.766466 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766466 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtmrd\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.766752 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.767036 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.767036 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.766775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.867867 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtmrd\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.867979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.868004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.868043    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.868250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.868328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.868487 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.868469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.869926 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.869903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.869995 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.869911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.875911 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.875868    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtmrd\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.876374 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.876355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token\") pod \"e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") " pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:39.988758 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:39.988667    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:40.119550 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.119471    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 20:46:40.122471 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:46:40.122444    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58042209_ef92_42f3_9b72_312defdb2797.slice/crio-f724e19225f451f03f09cc334a8ac7dbdb43093fe3990d62d9f66b89120e1e43 WatchSource:0}: Error finding container f724e19225f451f03f09cc334a8ac7dbdb43093fe3990d62d9f66b89120e1e43: Status 404 returned error can't find the container with id f724e19225f451f03f09cc334a8ac7dbdb43093fe3990d62d9f66b89120e1e43
Jul 27 20:46:40.124849 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.124816    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:40.124979 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.124898    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:40.124979 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.124945    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:40.170949 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.170924    2575 patch_prober.go:28] interesting pod/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:46:40.171042 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.170981    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:46:40.987185 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.987149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerStarted","Data":"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"}
Jul 27 20:46:40.987620 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.987231    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerStarted","Data":"f724e19225f451f03f09cc334a8ac7dbdb43093fe3990d62d9f66b89120e1e43"}
Jul 27 20:46:40.989500 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:40.989480    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:41.010144 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:41.010078    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" podStartSLOduration=2.010061542 podStartE2EDuration="2.010061542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:41.008313574 +0000 UTC m=+2572.202091968" watchObservedRunningTime="2026-07-27 20:46:41.010061542 +0000 UTC m=+2572.203839922"
Jul 27 20:46:41.994284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:41.994251    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:42.995632 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:42.995602    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:42.996659 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:42.996642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:44.001888 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.001858    2575 generic.go:356] "Generic (PLEG): container finished" podID="87524d75-b132-4358-8221-abd9bb70a630" containerID="c30d7ddac53984c441abe8f4a7884b47fddfea409ff0b92b05de5f00ec536617" exitCode=0
Jul 27 20:46:44.002308 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.001931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerDied","Data":"c30d7ddac53984c441abe8f4a7884b47fddfea409ff0b92b05de5f00ec536617"}
Jul 27 20:46:44.002308 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.001992    2575 scope.go:117] "RemoveContainer" containerID="e9e62ba51f55d0d2f83af0e4f3647aae7ae2aa3165f6ee1ff2ec14caebafad2c"
Jul 27 20:46:44.041378 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.041356    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:46:44.203628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203596    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203647    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203677    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203808    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zvxd\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.203884 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203851    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy\") pod \"87524d75-b132-4358-8221-abd9bb70a630\" (UID: \"87524d75-b132-4358-8221-abd9bb70a630\") "
Jul 27 20:46:44.204203 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:44.204203 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.203982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:44.204203 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.204029    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:44.204203 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.204195    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.204394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.204216    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.204394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.204231    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.204394 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.204290    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:44.205086 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.205052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data" (OuterVolumeSpecName: "istio-data") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:44.206222 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.206172    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:46:44.206326 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.206239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd" (OuterVolumeSpecName: "kube-api-access-7zvxd") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "kube-api-access-7zvxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:44.206326 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.206253    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token" (OuterVolumeSpecName: "istio-token") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:44.206411 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.206325    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87524d75-b132-4358-8221-abd9bb70a630" (UID: "87524d75-b132-4358-8221-abd9bb70a630"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:46:44.305537 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305502    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87524d75-b132-4358-8221-abd9bb70a630-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.305537 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305531    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.305537 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305540    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.305749 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305549    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zvxd\" (UniqueName: \"kubernetes.io/projected/87524d75-b132-4358-8221-abd9bb70a630-kube-api-access-7zvxd\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.305749 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305558    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87524d75-b132-4358-8221-abd9bb70a630-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:44.305749 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:44.305566    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87524d75-b132-4358-8221-abd9bb70a630-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:46:45.006688 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.006661    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"
Jul 27 20:46:45.007127 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.006709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9" event={"ID":"87524d75-b132-4358-8221-abd9bb70a630","Type":"ContainerDied","Data":"af060d07cf7ac2dc90aa8d05e9545f34123cecbf8b0363085c38222c8d491b0f"}
Jul 27 20:46:45.007127 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.006760    2575 scope.go:117] "RemoveContainer" containerID="c30d7ddac53984c441abe8f4a7884b47fddfea409ff0b92b05de5f00ec536617"
Jul 27 20:46:45.027892 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.027863    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:46:45.031635 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.031608    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5a7e30-openshift-default-6d547c7c9b-52bh9"]
Jul 27 20:46:45.423988 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:45.423957    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87524d75-b132-4358-8221-abd9bb70a630" path="/var/lib/kubelet/pods/87524d75-b132-4358-8221-abd9bb70a630/volumes"
Jul 27 20:46:48.093646 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093613    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093889    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093899    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093909    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093914    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093967    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093976    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="87524d75-b132-4358-8221-abd9bb70a630" containerName="istio-proxy"
Jul 27 20:46:48.093992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.093982    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd960fde-62eb-4c3b-9e14-926c3a5e7c11" containerName="istio-proxy"
Jul 27 20:46:48.097162 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.097139    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.099791 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.099769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-21ded0-openshift-default-dockercfg-rwzzs\""
Jul 27 20:46:48.111955 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.111927    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxfb\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.242803 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.241806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.342895 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.342854    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.342922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.342964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343103 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxfb\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343392 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343212    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343551 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.343551 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.344322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.343655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.344322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.344041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.344322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.344197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.347760 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.347707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.347964 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.347942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.356090 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.355699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxfb\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.356508 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.356486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token\") pod \"e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") " pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.407213 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.407159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:48.594864 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.594778    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 20:46:48.598654 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:46:48.598627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bc97f3_8e88_4b0c_94f7_222048d51be2.slice/crio-b067dd97ff999462cf0f0b3230c7d900e18f6225fd73dbd51e445cb4bf967179 WatchSource:0}: Error finding container b067dd97ff999462cf0f0b3230c7d900e18f6225fd73dbd51e445cb4bf967179: Status 404 returned error can't find the container with id b067dd97ff999462cf0f0b3230c7d900e18f6225fd73dbd51e445cb4bf967179
Jul 27 20:46:48.600744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.600710    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:48.600819 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.600778    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:48.600819 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:48.600806    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:49.025782 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:49.025743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerStarted","Data":"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"}
Jul 27 20:46:49.025958 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:49.025813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerStarted","Data":"b067dd97ff999462cf0f0b3230c7d900e18f6225fd73dbd51e445cb4bf967179"}
Jul 27 20:46:49.048829 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:49.048761    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podStartSLOduration=1.048737106 podStartE2EDuration="1.048737106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:49.046869289 +0000 UTC m=+2580.240647694" watchObservedRunningTime="2026-07-27 20:46:49.048737106 +0000 UTC m=+2580.242515487"
Jul 27 20:46:49.407917 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:49.407880    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:49.412827 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:49.412802    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:50.029782 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:50.029753    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:50.034852 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:50.034827    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:46:51.222940 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.222905    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 20:46:51.225862 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.225841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.236489 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.236460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-21ded0-serving-cert\""
Jul 27 20:46:51.238139 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.236789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-flzfl\""
Jul 27 20:46:51.242750 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.241401    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 20:46:51.374599 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.374559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xdh6\" (UniqueName: \"kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.374793 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.374624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.374793 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.374658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.476044 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.475950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.476044 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.475998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.476272 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.476089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xdh6\" (UniqueName: \"kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.476745 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.476724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.478463 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.478436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.485275 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.485254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xdh6\" (UniqueName: \"kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6\") pod \"maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.553276 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.553230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:51.709479 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.709451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 20:46:51.711832 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:46:51.711804    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3ac9df_e6a6_47a6_8b09_2091c28e406e.slice/crio-2c91781f33b08591dcf9b5993f1cc10899ca7f9affa00ca54438ba27aa673947 WatchSource:0}: Error finding container 2c91781f33b08591dcf9b5993f1cc10899ca7f9affa00ca54438ba27aa673947: Status 404 returned error can't find the container with id 2c91781f33b08591dcf9b5993f1cc10899ca7f9affa00ca54438ba27aa673947
Jul 27 20:46:51.713254 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:51.713234    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:46:52.042931 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:52.042896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" event={"ID":"5f3ac9df-e6a6-47a6-8b09-2091c28e406e","Type":"ContainerStarted","Data":"2c91781f33b08591dcf9b5993f1cc10899ca7f9affa00ca54438ba27aa673947"}
Jul 27 20:46:53.047715 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:53.047676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" event={"ID":"5f3ac9df-e6a6-47a6-8b09-2091c28e406e","Type":"ContainerStarted","Data":"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"}
Jul 27 20:46:53.048100 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:53.047788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:53.068759 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:53.068698    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" podStartSLOduration=1.7109646459999999 podStartE2EDuration="2.06867901s" totalImagesPullingTime="357.714364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:53.066631201 +0000 UTC m=+2584.260409603" watchObservedRunningTime="2026-07-27 20:46:53.06867901 +0000 UTC m=+2584.262457467"
Jul 27 20:46:55.055839 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.055813    2575 generic.go:356] "Generic (PLEG): container finished" podID="58042209-ef92-42f3-9b72-312defdb2797" containerID="38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436" exitCode=0
Jul 27 20:46:55.056224 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.055885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerDied","Data":"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"}
Jul 27 20:46:55.056303 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.056286    2575 scope.go:117] "RemoveContainer" containerID="38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"
Jul 27 20:46:55.057383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.057349    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:55.057463 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.057444    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:55.057511 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:55.057484    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:46:56.061646 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:56.061606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerStarted","Data":"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"}
Jul 27 20:46:56.989544 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:56.989501    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:56.990757 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:56.990726    2575 patch_prober.go:28] interesting pod/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 27 20:46:56.990898 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:56.990786    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 27 20:46:57.990142 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:57.990092    2575 patch_prober.go:28] interesting pod/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 27 20:46:57.990564 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:57.990161    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 27 20:46:57.996265 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:57.996239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:58.989359 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:58.989319    2575 patch_prober.go:28] interesting pod/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 27 20:46:58.989538 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:58.989384    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 27 20:46:59.057137 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:59.057109    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 20:46:59.993837 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:59.993805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:46:59.995125 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:46:59.995104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 20:47:06.071358 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:06.071313    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:47:06.071850 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:06.071404    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:47:07.108062 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.108031    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerID="52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847" exitCode=0
Jul 27 20:47:07.108492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.108084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerDied","Data":"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"}
Jul 27 20:47:07.108492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.108433    2575 scope.go:117] "RemoveContainer" containerID="52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"
Jul 27 20:47:07.109486 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.109457    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:47:07.109547 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.109524    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:47:07.109584 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:07.109556    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:47:08.119569 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:08.119537    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerStarted","Data":"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"}
Jul 27 20:47:08.407638 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:08.407598    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:47:08.407868 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:08.407843    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 27 20:47:08.407922 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:08.407897    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 27 20:47:09.408100 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:09.408057    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 27 20:47:09.408522 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:09.408118    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 27 20:47:10.407667 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:10.407630    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 27 20:47:10.407849 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:10.407697    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 27 20:47:11.408250 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:11.408218    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 27 20:47:11.408628 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:11.408279    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 27 20:47:12.411567 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:12.411538    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:47:12.412064 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:12.411922    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:47:12.412468 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:47:12.412452    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 20:55:44.608258 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.608221    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:55:44.611314 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.611297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.614393 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.614369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-366a10-serving-cert\""
Jul 27 20:55:44.629661 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.629626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:55:44.768846 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.768796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lmj\" (UniqueName: \"kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.769047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.768941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.769047 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.768984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.870124 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.870030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.870124 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.870071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.870124 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.870117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lmj\" (UniqueName: \"kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.870718 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.870697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.872502 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.872480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.880322 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.880294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lmj\" (UniqueName: \"kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj\") pod \"maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:44.921653 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:44.921630    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:45.059325 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:45.059147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:55:45.061629 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:55:45.061601    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62eb8a9a_2dd5_4885_9ba0_94ebeb952a90.slice/crio-02f8fa016d5009de491f9be5cd8f4bd6d22775f9a32c5f24308d798faf29bb2f WatchSource:0}: Error finding container 02f8fa016d5009de491f9be5cd8f4bd6d22775f9a32c5f24308d798faf29bb2f: Status 404 returned error can't find the container with id 02f8fa016d5009de491f9be5cd8f4bd6d22775f9a32c5f24308d798faf29bb2f
Jul 27 20:55:45.062911 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:45.062892    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:55:45.209522 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:45.209483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" event={"ID":"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90","Type":"ContainerStarted","Data":"02f8fa016d5009de491f9be5cd8f4bd6d22775f9a32c5f24308d798faf29bb2f"}
Jul 27 20:55:46.214973 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:46.214936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" event={"ID":"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90","Type":"ContainerStarted","Data":"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"}
Jul 27 20:55:46.215412 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:46.215061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:55:46.235312 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:46.235240    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" podStartSLOduration=1.718933818 podStartE2EDuration="2.235224962s" totalImagesPullingTime="516.291144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:46.234769623 +0000 UTC m=+3117.428548008" watchObservedRunningTime="2026-07-27 20:55:46.235224962 +0000 UTC m=+3117.429003342"
Jul 27 20:55:52.224877 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:55:52.224845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:56:03.753735 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.753704    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:56:03.756992 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.756972    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.759557 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.759540    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-3511f6-serving-cert\""
Jul 27 20:56:03.767644 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.767619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:56:03.839898 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.839863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.840070 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.839941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.840070 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.839970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.940492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.940458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.940678 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.940503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.940678 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.940525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.940678 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:56:03.940610    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-serving-cert: secret "maas-api-e2e-ipp-b-3511f6-serving-cert" not found
Jul 27 20:56:03.940802 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:56:03.940697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls podName:b60fba20-eeaf-4aa5-9fa5-a908f18d8a89 nodeName:}" failed. No retries permitted until 2026-07-27 20:56:04.440678095 +0000 UTC m=+3135.634456462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls") pod "maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" (UID: "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89") : secret "maas-api-e2e-ipp-b-3511f6-serving-cert" not found
Jul 27 20:56:03.941105 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.941087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:03.957776 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:03.957746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:04.445517 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:04.445479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:04.447746 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:04.447719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:04.669145 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:04.669112    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:04.797237 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:04.797213    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:56:04.799135 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:56:04.799108    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60fba20_eeaf_4aa5_9fa5_a908f18d8a89.slice/crio-a5a13b48a869698af15aa9ec3adac24e7e849341ce360ae0fbadd75df37d8e46 WatchSource:0}: Error finding container a5a13b48a869698af15aa9ec3adac24e7e849341ce360ae0fbadd75df37d8e46: Status 404 returned error can't find the container with id a5a13b48a869698af15aa9ec3adac24e7e849341ce360ae0fbadd75df37d8e46
Jul 27 20:56:05.297307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:05.297276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" event={"ID":"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89","Type":"ContainerStarted","Data":"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"}
Jul 27 20:56:05.297498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:05.297323    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" event={"ID":"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89","Type":"ContainerStarted","Data":"a5a13b48a869698af15aa9ec3adac24e7e849341ce360ae0fbadd75df37d8e46"}
Jul 27 20:56:05.297498 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:05.297354    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:56:05.314815 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:05.314765    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" podStartSLOduration=2.021027824 podStartE2EDuration="2.314749925s" totalImagesPullingTime="293.722101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:05.314227363 +0000 UTC m=+3136.508005768" watchObservedRunningTime="2026-07-27 20:56:05.314749925 +0000 UTC m=+3136.508528305"
Jul 27 20:56:11.307485 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:56:11.307454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:57:18.497930 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.497893    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:57:18.501457 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.501434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.503949 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.503931    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b060a0-openshift-default-dockercfg-8bxdq\""
Jul 27 20:57:18.521753 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.521721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:57:18.602613 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.602806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.602806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7pjj\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.602806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.602806 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.603025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.603025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.603025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.603025 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.602937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704063 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704063 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pjj\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704362 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704704 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704704 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704704 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.704704 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.704679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.705064 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.705039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.706578 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.706556    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.706775 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.706758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.713746 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.713719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.714432 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.714411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7pjj\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj\") pod \"e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") " pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.811656 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.811556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:18.952041 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.951956    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:57:18.954237 ip-10-0-133-107 kubenswrapper[2575]: W0727 20:57:18.954210    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b4669c_946e_435c_8793_9eb8848f88e3.slice/crio-29e93a7e3c384b0eedf7c7865803405ffe6e6a495ece0bd19a386d3ba79431c9 WatchSource:0}: Error finding container 29e93a7e3c384b0eedf7c7865803405ffe6e6a495ece0bd19a386d3ba79431c9: Status 404 returned error can't find the container with id 29e93a7e3c384b0eedf7c7865803405ffe6e6a495ece0bd19a386d3ba79431c9
Jul 27 20:57:18.956607 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.956571    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:18.956701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.956641    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:18.956701 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:18.956668    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:19.604349 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:19.604311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerStarted","Data":"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"}
Jul 27 20:57:19.604769 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:19.604369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerStarted","Data":"29e93a7e3c384b0eedf7c7865803405ffe6e6a495ece0bd19a386d3ba79431c9"}
Jul 27 20:57:19.625265 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:19.625210    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podStartSLOduration=1.625171755 podStartE2EDuration="1.625171755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:19.623277816 +0000 UTC m=+3210.817056196" watchObservedRunningTime="2026-07-27 20:57:19.625171755 +0000 UTC m=+3210.818950136"
Jul 27 20:57:19.811904 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:19.811877    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:20.817514 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:20.817483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:21.613073 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:21.613044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:21.613920 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:21.613903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:40.691370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.691281    2575 generic.go:356] "Generic (PLEG): container finished" podID="89b4669c-946e-435c-8793-9eb8848f88e3" containerID="1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718" exitCode=0
Jul 27 20:57:40.691370 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.691319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerDied","Data":"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"}
Jul 27 20:57:40.691792 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.691717    2575 scope.go:117] "RemoveContainer" containerID="1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"
Jul 27 20:57:40.692854 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.692813    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:40.692908 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.692896    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:40.692947 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:40.692928    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 27 20:57:41.697369 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:41.697336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerStarted","Data":"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"}
Jul 27 20:57:41.812134 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:41.812047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:41.812412 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:41.812388    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:57:41.812509 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:41.812442    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 27 20:57:42.812492 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:42.812453    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:57:42.812920 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:42.812525    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 27 20:57:43.812383 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:43.812345    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:57:43.812600 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:43.812412    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 27 20:57:44.812546 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:44.812511    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:57:44.812745 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:44.812589    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 27 20:57:45.815876 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:45.815845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:45.816323 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:45.816210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:57:45.816845 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:57:45.816820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:58:04.130248 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:04.130215    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:58:04.130777 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:04.130401    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy" containerID="cri-o://6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982" gracePeriod=30
Jul 27 20:58:09.376886 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.376858    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:58:09.479570 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479589    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7pjj\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479622    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479677    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479708    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.479744 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.480048 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479769    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.480048 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479784    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:09.480048 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.479796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket\") pod \"89b4669c-946e-435c-8793-9eb8848f88e3\" (UID: \"89b4669c-946e-435c-8793-9eb8848f88e3\") "
Jul 27 20:58:09.480048 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480007    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480063    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480099    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480217    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480233    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89b4669c-946e-435c-8793-9eb8848f88e3-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480246    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.480284 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480257    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.480583 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.480547    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:09.481940 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.481908    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj" (OuterVolumeSpecName: "kube-api-access-p7pjj") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "kube-api-access-p7pjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:09.482052 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.481969    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:09.482396 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.482372    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:58:09.482500 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.482374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "89b4669c-946e-435c-8793-9eb8848f88e3" (UID: "89b4669c-946e-435c-8793-9eb8848f88e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:09.580904 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.580867    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.580904 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.580896    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89b4669c-946e-435c-8793-9eb8848f88e3-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.580904 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.580906    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.581136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.580914    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7pjj\" (UniqueName: \"kubernetes.io/projected/89b4669c-946e-435c-8793-9eb8848f88e3-kube-api-access-p7pjj\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.581136 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.580924    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89b4669c-946e-435c-8793-9eb8848f88e3-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:09.816129 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.816038    2575 generic.go:356] "Generic (PLEG): container finished" podID="89b4669c-946e-435c-8793-9eb8848f88e3" containerID="6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982" exitCode=0
Jul 27 20:58:09.816129 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.816100    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"
Jul 27 20:58:09.816129 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.816122    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerDied","Data":"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"}
Jul 27 20:58:09.816404 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.816188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l" event={"ID":"89b4669c-946e-435c-8793-9eb8848f88e3","Type":"ContainerDied","Data":"29e93a7e3c384b0eedf7c7865803405ffe6e6a495ece0bd19a386d3ba79431c9"}
Jul 27 20:58:09.816404 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.816204    2575 scope.go:117] "RemoveContainer" containerID="6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"
Jul 27 20:58:09.824990 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.824970    2575 scope.go:117] "RemoveContainer" containerID="1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"
Jul 27 20:58:09.832566 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.832520    2575 scope.go:117] "RemoveContainer" containerID="6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"
Jul 27 20:58:09.832820 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:58:09.832800    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982\": container with ID starting with 6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982 not found: ID does not exist" containerID="6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"
Jul 27 20:58:09.832919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.832829    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982"} err="failed to get container status \"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982\": rpc error: code = NotFound desc = could not find container \"6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982\": container with ID starting with 6cf953c3da3ec0fdc784bec0f4fc23820140a5a223fc2d294b49be6d9bdf9982 not found: ID does not exist"
Jul 27 20:58:09.832919 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.832855    2575 scope.go:117] "RemoveContainer" containerID="1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"
Jul 27 20:58:09.833113 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:58:09.833093    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718\": container with ID starting with 1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718 not found: ID does not exist" containerID="1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"
Jul 27 20:58:09.833201 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.833121    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718"} err="failed to get container status \"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718\": rpc error: code = NotFound desc = could not find container \"1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718\": container with ID starting with 1d87f04676dfb2c3357a44c31d56df7664344e25bde541959e6c97ca948eb718 not found: ID does not exist"
Jul 27 20:58:09.841956 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.841930    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:58:09.846190 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:09.846157    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b060a0-openshift-default-5bc6cbbc4-x7k7l"]
Jul 27 20:58:11.423212 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:11.423160    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" path="/var/lib/kubelet/pods/89b4669c-946e-435c-8793-9eb8848f88e3/volumes"
Jul 27 20:58:26.129301 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.129269    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:58:26.129711 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.129469    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" podUID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" containerName="maas-api" containerID="cri-o://1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09" gracePeriod=30
Jul 27 20:58:26.378945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.378919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:58:26.420778 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.420708    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls\") pod \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") "
Jul 27 20:58:26.420778 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.420756    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca\") pod \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") "
Jul 27 20:58:26.420985 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.420863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5lmj\" (UniqueName: \"kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj\") pod \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\" (UID: \"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90\") "
Jul 27 20:58:26.421067 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.421036    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" (UID: "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:26.422820 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.422782    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj" (OuterVolumeSpecName: "kube-api-access-g5lmj") pod "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" (UID: "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90"). InnerVolumeSpecName "kube-api-access-g5lmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:26.422820 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.422814    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" (UID: "62eb8a9a-2dd5-4885-9ba0-94ebeb952a90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:58:26.522481 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.522448    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5lmj\" (UniqueName: \"kubernetes.io/projected/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-kube-api-access-g5lmj\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.522634 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.522494    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.522634 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.522516    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.891328 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.891295    2575 generic.go:356] "Generic (PLEG): container finished" podID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" containerID="1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09" exitCode=0
Jul 27 20:58:26.891489 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.891347    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"
Jul 27 20:58:26.891489 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.891359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" event={"ID":"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90","Type":"ContainerDied","Data":"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"}
Jul 27 20:58:26.891489 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.891399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z" event={"ID":"62eb8a9a-2dd5-4885-9ba0-94ebeb952a90","Type":"ContainerDied","Data":"02f8fa016d5009de491f9be5cd8f4bd6d22775f9a32c5f24308d798faf29bb2f"}
Jul 27 20:58:26.891489 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.891421    2575 scope.go:117] "RemoveContainer" containerID="1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"
Jul 27 20:58:26.899945 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.899924    2575 scope.go:117] "RemoveContainer" containerID="1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"
Jul 27 20:58:26.900229 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:58:26.900214    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09\": container with ID starting with 1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09 not found: ID does not exist" containerID="1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"
Jul 27 20:58:26.900290 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.900237    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09"} err="failed to get container status \"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09\": rpc error: code = NotFound desc = could not find container \"1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09\": container with ID starting with 1e984d4dcbe43bc30c204a9fb8ff0145d6a952200c24fd67c2ac364bb9b7cc09 not found: ID does not exist"
Jul 27 20:58:26.912002 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.911982    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:58:26.915767 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:26.915746    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-366a10-5d767fb879-gkt2z"]
Jul 27 20:58:27.423573 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:58:27.423546    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" path="/var/lib/kubelet/pods/62eb8a9a-2dd5-4885-9ba0-94ebeb952a90/volumes"
Jul 27 20:59:30.050974 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.050937    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:59:30.051511 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.051167    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" podUID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" containerName="maas-api" containerID="cri-o://84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205" gracePeriod=30
Jul 27 20:59:30.306307 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.306245    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:59:30.387081 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.387042    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca\") pod \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") "
Jul 27 20:59:30.387081 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.387083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") pod \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") "
Jul 27 20:59:30.387396 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.387121    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg\") pod \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\" (UID: \"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89\") "
Jul 27 20:59:30.387520 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.387493    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" (UID: "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:30.389214 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.389169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg" (OuterVolumeSpecName: "kube-api-access-dstmg") pod "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" (UID: "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89"). InnerVolumeSpecName "kube-api-access-dstmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:30.389316 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.389219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" (UID: "b60fba20-eeaf-4aa5-9fa5-a908f18d8a89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:59:30.487895 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.487860    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:59:30.487895 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.487887    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:59:30.487895 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:30.487899    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89-kube-api-access-dstmg\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 20:59:31.151697 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.151662    2575 generic.go:356] "Generic (PLEG): container finished" podID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" containerID="84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205" exitCode=0
Jul 27 20:59:31.152122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.151709    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"
Jul 27 20:59:31.152122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.151723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" event={"ID":"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89","Type":"ContainerDied","Data":"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"}
Jul 27 20:59:31.152122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.151773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx" event={"ID":"b60fba20-eeaf-4aa5-9fa5-a908f18d8a89","Type":"ContainerDied","Data":"a5a13b48a869698af15aa9ec3adac24e7e849341ce360ae0fbadd75df37d8e46"}
Jul 27 20:59:31.152122 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.151803    2575 scope.go:117] "RemoveContainer" containerID="84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"
Jul 27 20:59:31.160425 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.160403    2575 scope.go:117] "RemoveContainer" containerID="84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"
Jul 27 20:59:31.160681 ip-10-0-133-107 kubenswrapper[2575]: E0727 20:59:31.160662    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205\": container with ID starting with 84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205 not found: ID does not exist" containerID="84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"
Jul 27 20:59:31.160726 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.160689    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205"} err="failed to get container status \"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205\": rpc error: code = NotFound desc = could not find container \"84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205\": container with ID starting with 84daad7ec30666912525a2f2e78a99271c11ef2343fe305a18d3ca78d0f7d205 not found: ID does not exist"
Jul 27 20:59:31.184239 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.183969    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:59:31.185373 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.185346    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3511f6-84594bd647-z4mkx"]
Jul 27 20:59:31.424046 ip-10-0-133-107 kubenswrapper[2575]: I0727 20:59:31.423964    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" path="/var/lib/kubelet/pods/b60fba20-eeaf-4aa5-9fa5-a908f18d8a89/volumes"
Jul 27 21:00:02.929381 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:02.929348    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 21:00:02.929985 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:02.929562    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy" containerID="cri-o://6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6" gracePeriod=30
Jul 27 21:00:08.163337 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.163313    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 21:00:08.213002 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.212918    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213002 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.212968    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213017    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213076    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtmrd\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213133    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213241 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213215    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213546 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213246    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:08.213546 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213274    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token\") pod \"58042209-ef92-42f3-9b72-312defdb2797\" (UID: \"58042209-ef92-42f3-9b72-312defdb2797\") "
Jul 27 21:00:08.213546 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213436    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:08.213684 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213560    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.213684 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213581    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.213684 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213576    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:08.213684 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.213613    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:00:08.214121 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.214094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data" (OuterVolumeSpecName: "istio-data") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:08.215373 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.215351    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd" (OuterVolumeSpecName: "kube-api-access-mtmrd") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "kube-api-access-mtmrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:08.215373 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.215361    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:00:08.215513 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.215479    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token" (OuterVolumeSpecName: "istio-token") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:08.215550 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.215526    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58042209-ef92-42f3-9b72-312defdb2797" (UID: "58042209-ef92-42f3-9b72-312defdb2797"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:08.311971 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.311945    2575 generic.go:356] "Generic (PLEG): container finished" podID="58042209-ef92-42f3-9b72-312defdb2797" containerID="6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6" exitCode=0
Jul 27 21:00:08.312115 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.312007    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"
Jul 27 21:00:08.312115 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.312014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerDied","Data":"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"}
Jul 27 21:00:08.312115 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.312069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5" event={"ID":"58042209-ef92-42f3-9b72-312defdb2797","Type":"ContainerDied","Data":"f724e19225f451f03f09cc334a8ac7dbdb43093fe3990d62d9f66b89120e1e43"}
Jul 27 21:00:08.312115 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.312096    2575 scope.go:117] "RemoveContainer" containerID="6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"
Jul 27 21:00:08.314145 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314126    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58042209-ef92-42f3-9b72-312defdb2797-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314146    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtmrd\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-kube-api-access-mtmrd\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314161    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58042209-ef92-42f3-9b72-312defdb2797-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314170    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314194    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314205    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58042209-ef92-42f3-9b72-312defdb2797-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.314248 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.314217    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58042209-ef92-42f3-9b72-312defdb2797-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:08.320710 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.320694    2575 scope.go:117] "RemoveContainer" containerID="38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"
Jul 27 21:00:08.327774 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.327758    2575 scope.go:117] "RemoveContainer" containerID="6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"
Jul 27 21:00:08.328028 ip-10-0-133-107 kubenswrapper[2575]: E0727 21:00:08.328007    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6\": container with ID starting with 6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6 not found: ID does not exist" containerID="6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"
Jul 27 21:00:08.328076 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.328036    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6"} err="failed to get container status \"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6\": rpc error: code = NotFound desc = could not find container \"6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6\": container with ID starting with 6426814248ab7eac177784d9db8148cc9e0bba720d843ac36d6e26d13ef0c7b6 not found: ID does not exist"
Jul 27 21:00:08.328076 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.328053    2575 scope.go:117] "RemoveContainer" containerID="38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"
Jul 27 21:00:08.328330 ip-10-0-133-107 kubenswrapper[2575]: E0727 21:00:08.328311    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436\": container with ID starting with 38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436 not found: ID does not exist" containerID="38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"
Jul 27 21:00:08.328399 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.328336    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436"} err="failed to get container status \"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436\": rpc error: code = NotFound desc = could not find container \"38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436\": container with ID starting with 38c9baf0be86950e5366d63567ef52e1a07dca8e6a19171e0f699e1ecd3df436 not found: ID does not exist"
Jul 27 21:00:08.333401 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.333380    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 21:00:08.336750 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:08.336731    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4af3f5-openshift-default-ffd57d77b-xzlq5"]
Jul 27 21:00:09.423667 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:09.423631    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58042209-ef92-42f3-9b72-312defdb2797" path="/var/lib/kubelet/pods/58042209-ef92-42f3-9b72-312defdb2797/volumes"
Jul 27 21:00:13.976187 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:13.976136    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 21:00:13.976565 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:13.976406    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerName="maas-api" containerID="cri-o://ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530" gracePeriod=30
Jul 27 21:00:14.051962 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.051916    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.36:8443/health\": dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 27 21:00:14.214607 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.214582    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 21:00:14.261717 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.261625    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xdh6\" (UniqueName: \"kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6\") pod \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") "
Jul 27 21:00:14.261717 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.261703    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca\") pod \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") "
Jul 27 21:00:14.261937 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.261757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls\") pod \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\" (UID: \"5f3ac9df-e6a6-47a6-8b09-2091c28e406e\") "
Jul 27 21:00:14.263460 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.263414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f3ac9df-e6a6-47a6-8b09-2091c28e406e" (UID: "5f3ac9df-e6a6-47a6-8b09-2091c28e406e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:00:14.264711 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.264678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f3ac9df-e6a6-47a6-8b09-2091c28e406e" (UID: "5f3ac9df-e6a6-47a6-8b09-2091c28e406e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:00:14.265308 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.265277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6" (OuterVolumeSpecName: "kube-api-access-6xdh6") pod "5f3ac9df-e6a6-47a6-8b09-2091c28e406e" (UID: "5f3ac9df-e6a6-47a6-8b09-2091c28e406e"). InnerVolumeSpecName "kube-api-access-6xdh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:14.338052 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.338019    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerID="ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530" exitCode=0
Jul 27 21:00:14.338217 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.338063    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"
Jul 27 21:00:14.338217 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.338095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" event={"ID":"5f3ac9df-e6a6-47a6-8b09-2091c28e406e","Type":"ContainerDied","Data":"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"}
Jul 27 21:00:14.338217 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.338151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv" event={"ID":"5f3ac9df-e6a6-47a6-8b09-2091c28e406e","Type":"ContainerDied","Data":"2c91781f33b08591dcf9b5993f1cc10899ca7f9affa00ca54438ba27aa673947"}
Jul 27 21:00:14.338217 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.338193    2575 scope.go:117] "RemoveContainer" containerID="ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"
Jul 27 21:00:14.347455 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.347437    2575 scope.go:117] "RemoveContainer" containerID="ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"
Jul 27 21:00:14.347700 ip-10-0-133-107 kubenswrapper[2575]: E0727 21:00:14.347678    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530\": container with ID starting with ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530 not found: ID does not exist" containerID="ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"
Jul 27 21:00:14.347753 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.347708    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530"} err="failed to get container status \"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530\": rpc error: code = NotFound desc = could not find container \"ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530\": container with ID starting with ca155f67de7d563f9180e32cc7d1a382a6486fbaea8042597899c0f0755c4530 not found: ID does not exist"
Jul 27 21:00:14.359055 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.359033    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 21:00:14.362842 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.362823    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-openshift-service-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.362923 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.362844    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-maas-api-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.362923 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.362856    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xdh6\" (UniqueName: \"kubernetes.io/projected/5f3ac9df-e6a6-47a6-8b09-2091c28e406e-kube-api-access-6xdh6\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.368397 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:14.368377    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21ded0-7c6fcbbfc7-t9fwv"]
Jul 27 21:00:15.423709 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:15.423679    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" path="/var/lib/kubelet/pods/5f3ac9df-e6a6-47a6-8b09-2091c28e406e/volumes"
Jul 27 21:00:24.997645 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:24.997612    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 21:00:24.998114 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:24.997828    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" containerID="cri-o://6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653" gracePeriod=30
Jul 27 21:00:27.413908 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:27.413874    2575 patch_prober.go:28] interesting pod/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:00:27.414300 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:27.413942    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:00:30.246397 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.246372    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 21:00:30.402495 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.402460    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerID="6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653" exitCode=0
Jul 27 21:00:30.402665 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.402515    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"
Jul 27 21:00:30.402665 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.402528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerDied","Data":"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"}
Jul 27 21:00:30.402665 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.402592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7" event={"ID":"a1bc97f3-8e88-4b0c-94f7-222048d51be2","Type":"ContainerDied","Data":"b067dd97ff999462cf0f0b3230c7d900e18f6225fd73dbd51e445cb4bf967179"}
Jul 27 21:00:30.402665 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.402612    2575 scope.go:117] "RemoveContainer" containerID="6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"
Jul 27 21:00:30.403505 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403398    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klxfb\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403505 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403505 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403475    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403505 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403499    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403737 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403521    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403737 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403737 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403594    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403737 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403621    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403737 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403652    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket\") pod \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\" (UID: \"a1bc97f3-8e88-4b0c-94f7-222048d51be2\") "
Jul 27 21:00:30.403991 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403815    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:30.403991 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403918    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-certs\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.404095 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.403994    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:30.404334 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.404294    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:00:30.404556 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.404519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:30.404783 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.404756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:30.406209 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.406147    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:00:30.406308 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.406239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:30.406357 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.406311    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:30.406435 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.406415    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb" (OuterVolumeSpecName: "kube-api-access-klxfb") pod "a1bc97f3-8e88-4b0c-94f7-222048d51be2" (UID: "a1bc97f3-8e88-4b0c-94f7-222048d51be2"). InnerVolumeSpecName "kube-api-access-klxfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:30.420711 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.420693    2575 scope.go:117] "RemoveContainer" containerID="52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"
Jul 27 21:00:30.427906 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.427890    2575 scope.go:117] "RemoveContainer" containerID="6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"
Jul 27 21:00:30.428145 ip-10-0-133-107 kubenswrapper[2575]: E0727 21:00:30.428126    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653\": container with ID starting with 6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653 not found: ID does not exist" containerID="6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"
Jul 27 21:00:30.428202 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.428155    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653"} err="failed to get container status \"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653\": rpc error: code = NotFound desc = could not find container \"6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653\": container with ID starting with 6e05ced3754030234971b7d266d3cb15bd56d2f1f7b951dcd39fa191c6cbd653 not found: ID does not exist"
Jul 27 21:00:30.428202 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.428189    2575 scope.go:117] "RemoveContainer" containerID="52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"
Jul 27 21:00:30.428440 ip-10-0-133-107 kubenswrapper[2575]: E0727 21:00:30.428424    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847\": container with ID starting with 52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847 not found: ID does not exist" containerID="52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"
Jul 27 21:00:30.428482 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.428447    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847"} err="failed to get container status \"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847\": rpc error: code = NotFound desc = could not find container \"52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847\": container with ID starting with 52ba0989ae52813f5dda7c9ba874a338a9b130b863d28428cf5e5674513a7847 not found: ID does not exist"
Jul 27 21:00:30.504324 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504291    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-workload-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504324 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504319    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504324 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504328    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-credential-socket\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504554 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504336    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klxfb\" (UniqueName: \"kubernetes.io/projected/a1bc97f3-8e88-4b0c-94f7-222048d51be2-kube-api-access-klxfb\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504554 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504346    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-envoy\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504554 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504356    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-podinfo\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504554 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504363    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istio-data\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.504554 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.504370    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1bc97f3-8e88-4b0c-94f7-222048d51be2-istiod-ca-cert\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
Jul 27 21:00:30.724136 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.724104    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 21:00:30.728489 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:30.728465    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-21ded0-openshift-default-fb84f5b-vdsw7"]
Jul 27 21:00:31.422870 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:31.422836    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" path="/var/lib/kubelet/pods/a1bc97f3-8e88-4b0c-94f7-222048d51be2/volumes"
Jul 27 21:00:32.143363 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:32.143336    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-vfbqx_d5a5ab85-a4fa-49ad-a689-266cfe3ff585/copy-manifests/0.log"
Jul 27 21:00:32.153719 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:32.153693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-vfbqx_d5a5ab85-a4fa-49ad-a689-266cfe3ff585/manager/0.log"
Jul 27 21:00:33.006424 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:33.006386    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-f9rdq_7dbafa1a-007a-4196-beb4-6f9ac0f43590/postgres/0.log"
Jul 27 21:00:35.592550 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:35.592516    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7wvdc_741d2ae9-10f9-45cc-9342-2515a715c353/discovery/0.log"
Jul 27 21:00:36.641840 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:36.641811    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r47j6_48eda8d7-dde2-493d-99fa-ce72f43ff0e0/main/0.log"
Jul 27 21:00:36.756468 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:36.756438    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vxkfs_a7d83156-6b62-4c2a-925c-a8f4c889f2fe/main/0.log"
Jul 27 21:00:36.984681 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:36.984589    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq8wdz_52ecf647-0b73-4808-9575-3a1a9eb99b9e/main/0.log"
Jul 27 21:00:45.864786 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:45.864678    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wqggf_048b905f-b8e5-4d6f-a055-7a9a4735d314/global-pull-secret-syncer/0.log"
Jul 27 21:00:45.996205 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:45.996157    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-trcg4_3fcfdac9-7588-48a3-bdc7-ee54713f0431/konnectivity-agent/0.log"
Jul 27 21:00:46.040392 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:46.040358    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-107.ec2.internal_18c11acd5cd8d4a73c3376324fc2305f/haproxy/0.log"
Jul 27 21:00:54.100914 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:54.100880    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lplf2_9d981cf8-37b2-4895-b372-cf5b78ab47a0/node-exporter/0.log"
Jul 27 21:00:54.123854 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:54.123827    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lplf2_9d981cf8-37b2-4895-b372-cf5b78ab47a0/kube-rbac-proxy/0.log"
Jul 27 21:00:54.143706 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:54.143686    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lplf2_9d981cf8-37b2-4895-b372-cf5b78ab47a0/init-textfile/0.log"
Jul 27 21:00:56.139623 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139586    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"]
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139862    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139873    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139882    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139887    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139895    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139901    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139910    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139915    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139926    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139931    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139937    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139941    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139949    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139954    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139962    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139967    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139972    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.139977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" containerName="maas-api"
Jul 27 21:00:56.140012 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140020    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140028    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b4669c-946e-435c-8793-9eb8848f88e3" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140036    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140041    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58042209-ef92-42f3-9b72-312defdb2797" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140046    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140053    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="62eb8a9a-2dd5-4885-9ba0-94ebeb952a90" containerName="maas-api"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140058    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1bc97f3-8e88-4b0c-94f7-222048d51be2" containerName="istio-proxy"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140063    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b60fba20-eeaf-4aa5-9fa5-a908f18d8a89" containerName="maas-api"
Jul 27 21:00:56.140587 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.140068    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3ac9df-e6a6-47a6-8b09-2091c28e406e" containerName="maas-api"
Jul 27 21:00:56.143538 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.143517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.145736 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.145718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpxkn\"/\"default-dockercfg-z468q\""
Jul 27 21:00:56.146017 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.146001    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxkn\"/\"openshift-service-ca.crt\""
Jul 27 21:00:56.146562 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.146546    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxkn\"/\"kube-root-ca.crt\""
Jul 27 21:00:56.150745 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.150722    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"]
Jul 27 21:00:56.209056 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.209020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsdj4\" (UniqueName: \"kubernetes.io/projected/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-kube-api-access-zsdj4\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.209056 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.209062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-sys\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.209308 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.209084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-proc\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.209308 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.209140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-lib-modules\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.209308 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.209208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-podres\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309580 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsdj4\" (UniqueName: \"kubernetes.io/projected/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-kube-api-access-zsdj4\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309742 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-sys\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309742 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-proc\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309742 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-lib-modules\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309742 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-podres\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309907 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-sys\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309907 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-proc\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309907 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-lib-modules\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.309907 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.309859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-podres\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.318328 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.318307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsdj4\" (UniqueName: \"kubernetes.io/projected/7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8-kube-api-access-zsdj4\") pod \"perf-node-gather-daemonset-ztkkd\" (UID: \"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.453616 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.453515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:56.576373 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:56.576345    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"]
Jul 27 21:00:56.578980 ip-10-0-133-107 kubenswrapper[2575]: W0727 21:00:56.578955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c3dbd6e_80ed_45c1_aa62_6ece32fa60f8.slice/crio-0b206a37386d0c84a4a659a04757bfd2953fe09da0291041468f8d39e496f165 WatchSource:0}: Error finding container 0b206a37386d0c84a4a659a04757bfd2953fe09da0291041468f8d39e496f165: Status 404 returned error can't find the container with id 0b206a37386d0c84a4a659a04757bfd2953fe09da0291041468f8d39e496f165
Jul 27 21:00:57.506606 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:57.506561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd" event={"ID":"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8","Type":"ContainerStarted","Data":"76947b7b108331e00eb3793c46720fbe38d1362e8e49d207c0b4e384707363cd"}
Jul 27 21:00:57.506981 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:57.506623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd" event={"ID":"7c3dbd6e-80ed-45c1-aa62-6ece32fa60f8","Type":"ContainerStarted","Data":"0b206a37386d0c84a4a659a04757bfd2953fe09da0291041468f8d39e496f165"}
Jul 27 21:00:57.506981 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:57.506706    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:00:57.523109 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:57.523065    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd" podStartSLOduration=1.523050974 podStartE2EDuration="1.523050974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:57.521427824 +0000 UTC m=+3428.715206216" watchObservedRunningTime="2026-07-27 21:00:57.523050974 +0000 UTC m=+3428.716829354"
Jul 27 21:00:58.752393 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:58.752361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26s9d_e84b359d-9689-463a-9fd5-c9eb87e2bf1f/dns/0.log"
Jul 27 21:00:58.772991 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:58.772962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26s9d_e84b359d-9689-463a-9fd5-c9eb87e2bf1f/kube-rbac-proxy/0.log"
Jul 27 21:00:58.892629 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:58.892597    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgxdm_53761cb1-df13-4c43-ae36-69c409c4aeae/dns-node-resolver/0.log"
Jul 27 21:00:59.518784 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:00:59.518759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7gj2n_5cfe87db-d6b5-424f-84ef-1143c76da5f5/node-ca/0.log"
Jul 27 21:01:00.769650 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:00.769619    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7wvdc_741d2ae9-10f9-45cc-9342-2515a715c353/discovery/0.log"
Jul 27 21:01:01.799369 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:01.799343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxh9r_20cbf953-46ee-4c3a-951d-52b0a272b6b3/serve-healthcheck-canary/0.log"
Jul 27 21:01:02.505354 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:02.505328    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcv8x_8db1420a-d725-44d6-9a29-d625a4bfdff5/kube-rbac-proxy/0.log"
Jul 27 21:01:02.528162 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:02.528133    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcv8x_8db1420a-d725-44d6-9a29-d625a4bfdff5/exporter/0.log"
Jul 27 21:01:02.552606 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:02.552576    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcv8x_8db1420a-d725-44d6-9a29-d625a4bfdff5/extractor/0.log"
Jul 27 21:01:03.519652 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:03.519626    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-ztkkd"
Jul 27 21:01:05.437079 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:05.437047    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-vfbqx_d5a5ab85-a4fa-49ad-a689-266cfe3ff585/manager/0.log"
Jul 27 21:01:05.458285 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:05.458259    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-vfbqx_d5a5ab85-a4fa-49ad-a689-266cfe3ff585/copy-manifests/0.log"
Jul 27 21:01:06.755472 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:06.755449    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f9b5765bb-9jcxd_78db697f-5cf5-4ed9-8d23-03444cd04c34/manager/0.log"
Jul 27 21:01:06.886696 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:06.886661    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7wvdc_741d2ae9-10f9-45cc-9342-2515a715c353/discovery/0.log"
Jul 27 21:01:08.749122 ip-10-0-133-107 kubenswrapper[2575]: I0727 21:01:08.749092    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7wvdc_741d2ae9-10f9-45cc-9342-2515a715c353/discovery/0.log"